Apr 18 20:03:24 user devstack@n-api.service[61419]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 20:03:24 user devstack@n-api.service[61419]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 20:03:24 2023] *** Apr 18 20:03:24 user devstack@n-api.service[61419]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 20:03:24 user devstack@n-api.service[61419]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 20:03:24 user devstack@n-api.service[61419]: nodename: user Apr 18 20:03:24 user devstack@n-api.service[61419]: machine: x86_64 Apr 18 20:03:24 user devstack@n-api.service[61419]: clock source: unix Apr 18 20:03:24 user devstack@n-api.service[61419]: pcre jit disabled Apr 18 20:03:24 user devstack@n-api.service[61419]: detected number of CPU cores: 12 Apr 18 20:03:24 user devstack@n-api.service[61419]: current working directory: / Apr 18 20:03:24 user devstack@n-api.service[61419]: detected binary path: /usr/bin/uwsgi-core Apr 18 20:03:24 user devstack@n-api.service[61419]: your processes number limit is 63637 Apr 18 20:03:24 user devstack@n-api.service[61419]: your memory page size is 4096 bytes Apr 18 20:03:24 user devstack@n-api.service[61419]: detected max file descriptor number: 2048 Apr 18 20:03:24 user devstack@n-api.service[61419]: lock engine: pthread robust mutexes Apr 18 20:03:24 user devstack@n-api.service[61419]: thunder lock: enabled Apr 18 20:03:24 user devstack@n-api.service[61419]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 20:03:24 user devstack@n-api.service[61419]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 20:03:24 user devstack@n-api.service[61419]: Python main interpreter initialized at 0x563fc7225990 Apr 18 20:03:24 user devstack@n-api.service[61419]: python threads support enabled Apr 18 20:03:24 user devstack@n-api.service[61419]: your server socket listen backlog is limited to 100 connections Apr 18 20:03:24 user devstack@n-api.service[61419]: your mercy for graceful operations on workers is 90 seconds Apr 18 20:03:24 user devstack@n-api.service[61419]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 20:03:24 user devstack@n-api.service[61419]: *** Operational MODE: preforking *** Apr 18 20:03:24 user devstack@n-api.service[61419]: *** uWSGI is running in multiple interpreter mode *** Apr 18 20:03:24 user devstack@n-api.service[61419]: spawned uWSGI master process (pid: 61419) Apr 18 20:03:24 user devstack@n-api.service[61419]: spawned uWSGI worker 1 (pid: 61420, cores: 1) Apr 18 20:03:24 user devstack@n-api.service[61419]: spawned uWSGI worker 2 (pid: 61421, cores: 1) Apr 18 20:03:24 user devstack@n-api.service[61419]: spawned uWSGI worker 3 (pid: 61422, cores: 1) Apr 18 20:03:24 user devstack@n-api.service[61419]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 20:03:25 user devstack@n-api.service[61420]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 20:03:25 user devstack@n-api.service[61421]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 20:03:25 user devstack@n-api.service[61422]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 20:03:29 user devstack@n-api.service[61420]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 20:03:29 user devstack@n-api.service[61420]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 20:03:29 user devstack@n-api.service[61420]: and ``live_migration_inbound_addr`` respectively. Apr 18 20:03:29 user devstack@n-api.service[61420]: ). Its value may be silently ignored in the future. Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 20:03:29 user devstack@n-api.service[61422]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 20:03:29 user devstack@n-api.service[61422]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 20:03:29 user devstack@n-api.service[61422]: and ``live_migration_inbound_addr`` respectively. Apr 18 20:03:29 user devstack@n-api.service[61422]: ). Its value may be silently ignored in the future. Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 20:03:29 user devstack@n-api.service[61421]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 20:03:29 user devstack@n-api.service[61421]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 20:03:29 user devstack@n-api.service[61421]: and ``live_migration_inbound_addr`` respectively. Apr 18 20:03:29 user devstack@n-api.service[61421]: ). Its value may be silently ignored in the future. Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61420) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61422) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:03:29 user devstack@n-api.service[61420]: INFO dbcounter [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Registered counter for database nova_api Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61421) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61420) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writer thread running {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61422]: INFO dbcounter [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Registered counter for database nova_api Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.context [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),285bd6ea-7144-4ccd-a44d-fb1de459fade(cell1) {{(pid=61420) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:03:29 user devstack@n-api.service[61420]: INFO dbcounter [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Registered counter for database nova_cell0 Apr 18 20:03:29 user devstack@n-api.service[61420]: INFO dbcounter [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Registered counter for database nova_cell1 Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61420) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61421]: INFO dbcounter [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Registered counter for database nova_api Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61420) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG nova.context [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),285bd6ea-7144-4ccd-a44d-fb1de459fade(cell1) {{(pid=61422) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writer thread running {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writer thread running {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:03:29 user devstack@n-api.service[61422]: INFO dbcounter [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Registered counter for database nova_cell0 Apr 18 20:03:29 user devstack@n-api.service[61422]: INFO dbcounter [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Registered counter for database nova_cell1 Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_db.sqlalchemy.engines [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61421) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writer thread running {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG nova.context [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),285bd6ea-7144-4ccd-a44d-fb1de459fade(cell1) {{(pid=61421) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:03:29 user devstack@n-api.service[61421]: INFO dbcounter [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Registered counter for database nova_cell0 Apr 18 20:03:29 user devstack@n-api.service[61421]: INFO dbcounter [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Registered counter for database nova_cell1 Apr 18 20:03:29 user devstack@n-api.service[61420]: INFO dbcounter [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Registered counter for database nova_cell0 Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_db.sqlalchemy.engines [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61421) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writer thread running {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_db.sqlalchemy.engines [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61421) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61420) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writer thread running {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61422]: INFO dbcounter [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Registered counter for database nova_cell0 Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG oslo_db.sqlalchemy.engines [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61422) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writer thread running {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writer thread running {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61421]: INFO dbcounter [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Registered counter for database nova_cell0 Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG oslo_db.sqlalchemy.engines [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61421) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:03:29 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writer thread running {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:03:29 user devstack@n-api.service[61420]: WARNING keystonemiddleware.auth_token [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:03:29 user devstack@n-api.service[61420]: WARNING keystonemiddleware.auth_token [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:03:29 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:03:29 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:03:29 user devstack@n-api.service[61420]: WARNING keystonemiddleware.auth_token [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:03:29 user devstack@n-api.service[61420]: WARNING keystonemiddleware.auth_token [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:03:29 user devstack@n-api.service[61420]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x563fc7225990 pid: 61420 (default app) Apr 18 20:03:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:03:29 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001592 Apr 18 20:03:29 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 20:03:29 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:03:29 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:03:29 user devstack@n-api.service[61422]: WARNING keystonemiddleware.auth_token [None req-b3d5ab86-d7e2-4201-8c32-ad4cb9c1b21f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:03:30 user devstack@n-api.service[61422]: WSGI app 0 (mountpoint='') ready in 4 seconds on interpreter 0x563fc7225990 pid: 61422 (default app) Apr 18 20:03:30 user devstack@n-api.service[61421]: WARNING keystonemiddleware.auth_token [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:03:30 user devstack@n-api.service[61421]: WARNING keystonemiddleware.auth_token [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:03:30 user devstack@n-api.service[61421]: WARNING keystonemiddleware.auth_token [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:03:30 user devstack@n-api.service[61421]: WARNING keystonemiddleware.auth_token [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:03:30 user devstack@n-api.service[61421]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563fc7225990 pid: 61421 (default app) Apr 18 20:05:35 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:35 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-e0f40d52-6298-4f09-b67a-c14b911cf315 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002234 Apr 18 20:05:35 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:35 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:35 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:35 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:35 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:35 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b585d24e-227e-4f3c-92a7-821aea7325fd admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b585d24e-227e-4f3c-92a7-821aea7325fd admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.374396 Apr 18 20:05:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 20:05:35 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:38 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:38 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.005197 Apr 18 20:05:38 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:38 2023] GET /compute/v2.1 => generated 387 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:38 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:38 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:38 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:38 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:38 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-35322acf-75ae-4c32-a318-bea294c64e47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "swap": 0, "name": "cirros256", "vcpus": 1, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-35322acf-75ae-4c32-a318-bea294c64e47 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.376610 Apr 18 20:05:38 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:38 2023] POST /compute/v2.1/flavors => generated 405 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 18 20:05:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1ce13079-f14e-4e5d-9f6b-685f6e2b964b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-1ce13079-f14e-4e5d-9f6b-685f6e2b964b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046680 Apr 18 20:05:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:05:38 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:40 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:40 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001394 Apr 18 20:05:40 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:40 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-87e094a4-7666-4e6a-bcbf-1a4e5fd2d5a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:40 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-87e094a4-7666-4e6a-bcbf-1a4e5fd2d5a4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.068438 Apr 18 20:05:40 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:40 2023] POST /compute/v2.1/flavors => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dc119d6a-c9be-46da-b8da-e290d1287e4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-dc119d6a-c9be-46da-b8da-e290d1287e4d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029013 Apr 18 20:05:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:05:40 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002069 Apr 18 20:05:42 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:42 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-9c9c7840-090f-4b51-92fc-0ae2d1d844d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:42 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-9c9c7840-090f-4b51-92fc-0ae2d1d844d2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.063816 Apr 18 20:05:42 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:42 2023] POST /compute/v2.1/flavors => generated 402 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-27e845c6-ec4e-4edc-a896-598b4b8301e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-27e845c6-ec4e-4edc-a896-598b4b8301e7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025784 Apr 18 20:05:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:05:42 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:44 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:44 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002037 Apr 18 20:05:44 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:44 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:44 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-cd50ae67-ceed-45e0-a7b4-1d35635341a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds2G", "id": "d3", "ram": 2048, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:44 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-cd50ae67-ceed-45e0-a7b4-1d35635341a8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073143 Apr 18 20:05:44 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5dd71c74-7a34-4927-ace9-b614e647e88f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:44 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5dd71c74-7a34-4927-ace9-b614e647e88f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023649 Apr 18 20:05:44 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:05:44 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:46 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:46 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001414 Apr 18 20:05:46 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:46 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-408b1bbb-f905-4d2e-96fb-55b0ebcb4ae2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "id": "d4", "vcpus": 4, "ram": 4096, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:46 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-408b1bbb-f905-4d2e-96fb-55b0ebcb4ae2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060440 Apr 18 20:05:46 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023273 Apr 18 20:05:46 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:05:46 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:48 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:48 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26ef99f6-81ea-47dc-8df8-c54d33b5ba53 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001390 Apr 18 20:05:48 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:48 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-24de0550-d595-44c1-9a74-cef8df645067 admin admin] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-24de0550-d595-44c1-9a74-cef8df645067 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.089565 Apr 18 20:05:48 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 20:05:48 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:05:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001641 Apr 18 20:05:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:50 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=3 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:50 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=3 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:50 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=3 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:50 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=3 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:05:50 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-31fd2b25-b8bc-4a2c-90b8-970bf3dda0e2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:50 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-31fd2b25-b8bc-4a2c-90b8-970bf3dda0e2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.317914 Apr 18 20:05:50 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:50 2023] POST /compute/v2.1/flavors => generated 400 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:50 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-6074e311-ce64-48d2-a951-1df8b1c75879 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:50 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-6074e311-ce64-48d2-a951-1df8b1c75879 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042391 Apr 18 20:05:50 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:05:50 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001405 Apr 18 20:05:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:52 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-dbde28a2-ae94-4ad4-9dbb-0f9eb5d6c240 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "disk": 20, "vcpus": 1}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:52 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-dbde28a2-ae94-4ad4-9dbb-0f9eb5d6c240 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.061133 Apr 18 20:05:52 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:52 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:52 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-519e2339-9c7f-404b-9941-4e426a4c2fc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:52 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-519e2339-9c7f-404b-9941-4e426a4c2fc6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027121 Apr 18 20:05:52 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:05:52 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001420 Apr 18 20:05:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:54 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:54 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-be9851e2-966b-476c-9432-583e357fa60f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "name": "m1.medium", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3"}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:54 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-be9851e2-966b-476c-9432-583e357fa60f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060418 Apr 18 20:05:54 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:54 2023] POST /compute/v2.1/flavors => generated 404 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:54 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-f95efb39-9602-4016-ba55-eb76b3f971f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:54 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-f95efb39-9602-4016-ba55-eb76b3f971f1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030449 Apr 18 20:05:54 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:05:54 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001330 Apr 18 20:05:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:56 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a1315066-390b-46a6-9038-bb9b0409ebbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "rxtx_factor": 1.0}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:56 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-a1315066-390b-46a6-9038-bb9b0409ebbe admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.064568 Apr 18 20:05:56 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:56 2023] POST /compute/v2.1/flavors => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:56 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-3812de5b-244f-4fc3-b9f7-d65367701da7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:56 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-3812de5b-244f-4fc3-b9f7-d65367701da7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025097 Apr 18 20:05:56 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:05:56 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:05:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:05:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001453 Apr 18 20:05:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:05:58 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:05:58 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-704c7058-f5b4-4e70-a878-14ad935bd846 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:58 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-704c7058-f5b4-4e70-a878-14ad935bd846 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067072 Apr 18 20:05:58 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:05:58 2023] POST /compute/v2.1/flavors => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:05:58 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-840eb274-1b9a-42c4-b26c-b44546e5c915 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:05:58 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-840eb274-1b9a-42c4-b26c-b44546e5c915 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026927 Apr 18 20:05:58 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:05:58 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:06:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:06:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-70f33ab6-8e0c-4b2a-82bc-3a4208851a28 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001508 Apr 18 20:06:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:06:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:06:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:06:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087987 Apr 18 20:06:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 20:06:30 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:07:02 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-840eb274-1b9a-42c4-b26c-b44546e5c915 admin admin] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:07:02 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-840eb274-1b9a-42c4-b26c-b44546e5c915 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002797 Apr 18 20:07:02 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:07:02 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:07:02 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:07:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-29b6d355-2620-47bc-a08f-02bf0f0252f4 admin admin] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:07:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-29b6d355-2620-47bc-a08f-02bf0f0252f4 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.065654 Apr 18 20:07:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 20:07:02 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:07:07 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:07:07 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002186 Apr 18 20:07:07 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:07:07 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:07:07 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:07:07 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a27e37f2-a3be-47a7-b57d-09174c002d5f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 128, "name": "m1.nano", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "id": "42", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:07:07 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-a27e37f2-a3be-47a7-b57d-09174c002d5f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.087779 Apr 18 20:07:07 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 20:07:07 2023] POST /compute/v2.1/flavors => generated 403 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:07:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-03d6e696-0950-462e-a161-f12fee6b11c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:07:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-03d6e696-0950-462e-a161-f12fee6b11c7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045478 Apr 18 20:07:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 20:07:07 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:07:11 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:07:11 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-a8e3625a-6fc5-4451-8e0e-fd44f33dcf84 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001550 Apr 18 20:07:11 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:07:11 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:07:11 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-671eb134-b0a0-4cff-bded-41cca56ed619 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "id": "84", "os-flavor-access:is_public": true, "swap": 0, "disk": 1, "vcpus": 1, "name": "m1.micro", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:07:11 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-671eb134-b0a0-4cff-bded-41cca56ed619 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061500 Apr 18 20:07:11 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 20:07:11 2023] POST /compute/v2.1/flavors => generated 404 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:07:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9710c379-7d52-4aae-b46e-8973a01b55e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:07:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9710c379-7d52-4aae-b46e-8973a01b55e0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033384 Apr 18 20:07:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 20:07:11 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:09:23 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:09:23 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:09:23 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:09:24 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-b5ac923f-7de4-488b-8b34-ac6697708cc3 tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Action: 'create', calling method: .version_select at 0x7fb774666ef0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-440891953", "metadata": {"Type": "work"}}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-b5ac923f-7de4-488b-8b34-ac6697708cc3 tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.858093 Apr 18 20:09:25 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:09:23 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 1860 msecs (HTTP/1.1 200) 10 headers in 447 bytes (2 switches on core 0) Apr 18 20:09:25 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:09:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5c323d47-aa4c-4ddc-9c1e-292854e87cd8 tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Calling method '.version_select at 0x7fb774665f30>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:26 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-5c323d47-aa4c-4ddc-9c1e-292854e87cd8 tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2" status: 200 len: 349 microversion: 2.1 time: 0.349881 Apr 18 20:09:26 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:09:25 2023] GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2 => generated 349 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:09:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c95fef98-8a1d-4c1d-9979-60eca300d06c tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Calling method '.version_select at 0x7fb774725240>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c95fef98-8a1d-4c1d-9979-60eca300d06c tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2" status: 200 len: 349 microversion: 2.1 time: 0.369394 Apr 18 20:09:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:09:27 2023] GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2 => generated 349 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:27 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-1b9eba8b-5cee-45ef-ad46-108208679e33 tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Calling method '.version_select at 0x7fb7746f4670>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:27 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-1b9eba8b-5cee-45ef-ad46-108208679e33 tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2" status: 202 len: 0 microversion: 2.1 time: 0.204563 Apr 18 20:09:27 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:09:27 2023] DELETE /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:09:27 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2c13aa14-62b5-4bcb-b129-1f7f85cc50fa tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Calling method '.version_select at 0x7fb7746eb760>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:27 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-2c13aa14-62b5-4bcb-b129-1f7f85cc50fa tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] HTTP exception thrown: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. Apr 18 20:09:27 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2c13aa14-62b5-4bcb-b129-1f7f85cc50fa tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Request method failure captured: Apr 18 20:09:27 user devstack@n-api.service[61420]: request: GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2 HTTP/1.1 Apr 18 20:09:27 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:09:27 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:09:27 user devstack@n-api.service[61420]: Connection: close Apr 18 20:09:27 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:09:27 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:09:27 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:09:27 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:09:27 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvjz0r8PwyhjbjiVLs75ml9B3CcdWnbmqO5if2gY7c-dpPrZYKd-dKGeddmipWI_oMM6393mw0eQQr_-AoEx-fBhGVmZtqPoVx7FKzCTh3lFMCGyJz9YtsHvjBCFPdsOa3v1mGm7Z-VBVdXhuSKFPfOoFlQJZkWQeFPUIIRJe0641Xw Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Project-Id: f5bd882fc35949b58ce5d97822ac94b8 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Project-Name: tempest-VolumesGetTestJSON-487257874 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5bd882fc35949b58ce5d97822ac94b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f5bd882fc35949b58ce5d97822ac94b8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f5bd882fc35949b58ce5d97822ac94b8"}]}] Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Tenant: tempest-VolumesGetTestJSON-487257874 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Tenant-Id: f5bd882fc35949b58ce5d97822ac94b8 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-VolumesGetTestJSON-487257874 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-User: tempest-VolumesGetTestJSON-487257874-project-member Apr 18 20:09:27 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:09:27 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:09:27 user devstack@n-api.service[61420]: X-User-Id: 0450b04c0fd84b6497af6dce14e585a5 Apr 18 20:09:27 user devstack@n-api.service[61420]: X-User-Name: tempest-VolumesGetTestJSON-487257874-project-member Apr 18 20:09:27 user devstack@n-api.service[61420]: method: Apr 18 20:09:27 user devstack@n-api.service[61420]: exception: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. Apr 18 20:09:27 user devstack@n-api.service[61420]: action_args: {'id': '9ad02665-80a3-4c42-96a6-ae736b6b22b2'} Apr 18 20:09:27 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. (HTTP 404) (Request-ID: req-9aaf5ff1-29ed-48ac-8f49-55a12e6fe6e1) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. Apr 18 20:09:27 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:09:27 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2c13aa14-62b5-4bcb-b129-1f7f85cc50fa tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] Returning 404 to user: Volume 9ad02665-80a3-4c42-96a6-ae736b6b22b2 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:09:27 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-2c13aa14-62b5-4bcb-b129-1f7f85cc50fa tempest-VolumesGetTestJSON-487257874 tempest-VolumesGetTestJSON-487257874-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2" status: 404 len: 109 microversion: 2.1 time: 0.041466 Apr 18 20:09:27 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:09:27 2023] GET /compute/v2.1/os-volumes/9ad02665-80a3-4c42-96a6-ae736b6b22b2 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:09:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1950503984", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "5b16deaf-2b61-4095-91ec-8e78f9af18fe"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:40 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] validate_networks() for [('5b16deaf-2b61-4095-91ec-8e78f9af18fe', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:09:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-c8f02b29-0364-4dcc-a9bc-cc4115ff7677 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Action: 'create', calling method: .version_select at 0x7fb7746f49d0>, body: {"keypair": {"name": "tempest-keypair-989202719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcRm8U1MQf78x1Tct2ojEPLcJOlYqq4DB5gSXCFsvkWP+RDylOF/o/HHJImLQfgHC3z0XnnR8EDEFLzDZMW6znIcvcnLQvhO+UJLRzQi3JPHq1rjR5jzhCUYZ+URr+mAw=="}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:42 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-c8f02b29-0364-4dcc-a9bc-cc4115ff7677 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Getting quotas for project 4e1c758096d340d5bc72df80fae46f7d. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:42 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-c8f02b29-0364-4dcc-a9bc-cc4115ff7677 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Getting quotas for user 2f19bcf69a6c4abca9f0744965a79d66 and project 4e1c758096d340d5bc72df80fae46f7d. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:42 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4a113eb1-62cc-4149-a0e3-ff09013a1e65 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Action: 'create', calling method: .version_select at 0x7fb774540e50>, body: {"keypair": {"name": "tempest-keypair-695000765", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN+NeNcb194nGbp7ORCDl4m3yIVTm8I2CoP1rj3tPkydpLtG0xT8yk3wMhWSEUXDm/ND9ohkxmIRCNNvn/GJ0c2n432Pj+8IFk51pxlYRttTEuEtuxbvVZsj3p1uAhWVow=="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-c8f02b29-0364-4dcc-a9bc-cc4115ff7677 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.256260 Apr 18 20:09:42 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:09:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:42 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-4a113eb1-62cc-4149-a0e3-ff09013a1e65 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for project a4584427b930494cbce6719967c325da. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:42 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-4a113eb1-62cc-4149-a0e3-ff09013a1e65 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for user 2621a49d58c34c948ee000a94751a585 and project a4584427b930494cbce6719967c325da. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:42 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4a113eb1-62cc-4149-a0e3-ff09013a1e65 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.293609 Apr 18 20:09:42 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 19/52] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:09:42 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for user 4918574af24b49d1b355bd3970ef6be4 and project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:09:42 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:09:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c094a330-bc8f-4c24-953c-1b96577f1105 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 2.567031 Apr 18 20:09:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 17/53] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:09:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 20:09:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-59c04a41-f95b-4a8a-99db-9d145f8aa652 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:42 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-59c04a41-f95b-4a8a-99db-9d145f8aa652 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:09:43 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-59c04a41-f95b-4a8a-99db-9d145f8aa652 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:43 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-59c04a41-f95b-4a8a-99db-9d145f8aa652 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:43 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-59c04a41-f95b-4a8a-99db-9d145f8aa652 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:43 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-59c04a41-f95b-4a8a-99db-9d145f8aa652 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b" status: 200 len: 1395 microversion: 2.87 time: 0.149476 Apr 18 20:09:43 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 18/54] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:09:42 2023] GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b => generated 1395 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 20:09:43 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-f31db393-41b8-4604-b2f8-456b50c7ce14 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Action: 'create', calling method: .version_select at 0x7fb7745c5b40>, body: {"keypair": {"name": "tempest-keypair-228834592", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPAg+ArQss7gTE+r25wB/q7ZQu6dsu296BvE2gJnm3RKYPzhOURMvkGIKdlHnmqVBP9/PI/ok6Qp6qxIaqOcMQjBuAy4vLSOphIBRxOTtL1ws2ItBgM141NYjgLj1Tj0Qg=="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:43 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-f31db393-41b8-4604-b2f8-456b50c7ce14 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:43 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-f31db393-41b8-4604-b2f8-456b50c7ce14 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for user 14e8456e134e454a82496708ce268345 and project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:43 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-f31db393-41b8-4604-b2f8-456b50c7ce14 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.306220 Apr 18 20:09:43 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 20/55] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 20:09:43 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 308 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 20:09:44 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1090976092", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "cb9f97a9-ae6b-418f-b997-6e0828702011"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:44 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] validate_networks() for [('cb9f97a9-ae6b-418f-b997-6e0828702011', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Getting quotas for project 496dfb775be64f09ad5d908edb15e484. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Getting quotas for user fda81ab9b2da4cd6b75e87c5085cfd1a and project 496dfb775be64f09ad5d908edb15e484. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:09:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:09:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-66aa662f-60fb-4554-b550-aa9729dd6eb1 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.344701 Apr 18 20:09:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 18/56] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:09:44 2023] POST /compute/v2.1/servers => generated 378 bytes in 1347 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:09:45 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-3124fd52-71b7-4dcf-bd97-016cad4e700e tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:45 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-3124fd52-71b7-4dcf-bd97-016cad4e700e tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:09:45 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-3124fd52-71b7-4dcf-bd97-016cad4e700e tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81ab9b2da4cd6b75e87c5085cfd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dfb775be64f09ad5d908edb15e484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:45 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-3124fd52-71b7-4dcf-bd97-016cad4e700e tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037" status: 200 len: 1209 microversion: 2.1 time: 0.289596 Apr 18 20:09:45 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:09:45 2023] GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037 => generated 1209 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:09:46 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-76814063", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "17b0d5ba-0865-4582-ad2d-392745c9e217"}], "security_groups": [{"name": "tempest-securitygroup--257771409"}], "key_name": "tempest-keypair-989202719", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:46 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] validate_networks() for [('17b0d5ba-0865-4582-ad2d-392745c9e217', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:09:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-747456920", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1a455dc1-6931-43c6-b404-a42a7505cffe"}], "security_groups": [{"name": "tempest-securitygroup--1734558389"}], "key_name": "tempest-keypair-695000765", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:46 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] validate_networks() for [('1a455dc1-6931-43c6-b404-a42a7505cffe', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:09:47 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:09:47 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:09:47 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:09:47 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:09:47 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Getting quotas for project 4e1c758096d340d5bc72df80fae46f7d. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Getting quotas for user 2f19bcf69a6c4abca9f0744965a79d66 and project 4e1c758096d340d5bc72df80fae46f7d. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:09:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-cbdbc23c-2ad0-4496-a6cb-5cfb589deec8 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.797296 Apr 18 20:09:48 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 21/58] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:09:46 2023] POST /compute/v2.1/servers => generated 403 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:09:48 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-b9e6e041-ce8f-4d20-8b2c-b4682b663521 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:48 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-b9e6e041-ce8f-4d20-8b2c-b4682b663521 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for project a4584427b930494cbce6719967c325da. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for user 2621a49d58c34c948ee000a94751a585 and project a4584427b930494cbce6719967c325da. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:09:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:09:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-eda9f7e5-3664-4c02-9c4e-410efdd2ed58 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.561585 Apr 18 20:09:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 19/59] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:09:46 2023] POST /compute/v2.1/servers => generated 400 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-57fd7f88-6f9a-4629-8ccb-84eb74e3b3d3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-57fd7f88-6f9a-4629-8ccb-84eb74e3b3d3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:09:48 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-b9e6e041-ce8f-4d20-8b2c-b4682b663521 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f19bcf69a6c4abca9f0744965a79d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1c758096d340d5bc72df80fae46f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:48 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-b9e6e041-ce8f-4d20-8b2c-b4682b663521 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 200 len: 1237 microversion: 2.1 time: 0.172740 Apr 18 20:09:48 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 20/60] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:09:48 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 1237 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:09:48 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-57fd7f88-6f9a-4629-8ccb-84eb74e3b3d3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621a49d58c34c948ee000a94751a585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4584427b930494cbce6719967c325da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-57fd7f88-6f9a-4629-8ccb-84eb74e3b3d3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 200 len: 1230 microversion: 2.1 time: 0.186975 Apr 18 20:09:48 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 22/61] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:09:48 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 1230 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:09:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-272178052", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d859f7bf-51df-4961-aaf1-e1fc33d6fce1"}], "security_groups": [{"name": "tempest-securitygroup--1696078466"}], "key_name": "tempest-keypair-228834592", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:49 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] validate_networks() for [('d859f7bf-51df-4961-aaf1-e1fc33d6fce1', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:51 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:09:51 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for user 14e8456e134e454a82496708ce268345 and project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:09:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:09:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:09:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-87f53570-4ff5-4fc2-829e-9139a2131fe0 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.915900 Apr 18 20:09:51 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 20/62] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:09:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 1918 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 20:09:51 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-15f8c72e-e611-4455-80ff-a52168eb1e4b tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:09:51 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-15f8c72e-e611-4455-80ff-a52168eb1e4b tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:09:51 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-15f8c72e-e611-4455-80ff-a52168eb1e4b tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:51 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-15f8c72e-e611-4455-80ff-a52168eb1e4b tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:51 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-15f8c72e-e611-4455-80ff-a52168eb1e4b tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:09:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-15f8c72e-e611-4455-80ff-a52168eb1e4b tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 200 len: 1274 microversion: 2.20 time: 0.333814 Apr 18 20:09:51 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:09:51 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 1274 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd9040f3-b694-4af2-9486-854bf4d3b037", "tag": "751bbee4-55f7-4cb4-96f9-a760cfa4b240"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:52 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Creating event network-changed:751bbee4-55f7-4cb4-96f9-a760cfa4b240 for instance cd9040f3-b694-4af2-9486-854bf4d3b037 on user Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61420) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6e68bddf-a5f8-4a4c-b876-73fe63468352 req-fcd2326f-ddef-4242-aa45-c21466ddfc4d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61420) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:52 user devstack@n-api.service[61420]: INFO nova.compute.rpcapi [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 20:09:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=61420) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 20:09:52 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-d7b45a96-a12f-40d1-9d84-1834ea7e35a8 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230042 Apr 18 20:09:52 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 23/64] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:09:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Creating event network-changed:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61422) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-b0a12bc8-1d2f-4901-b56f-412d3cc250a0 req-e7754784-65f5-4156-880f-60a99e12e083 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61422) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:52 user devstack@n-api.service[61422]: INFO nova.compute.rpcapi [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 20:09:52 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] Releasing lock "compute-rpcapi-router" {{(pid=61422) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 20:09:52 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-48ab064c-fafe-4390-bed9-35a5d60199fa None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187829 Apr 18 20:09:52 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 21/65] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:09:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349b3f34-40ef-416e-a077-7cc112925c2b", "tag": "7dbb2500-fd31-400b-8ce1-bf1230143a6a"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:53 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Creating event network-changed:7dbb2500-fd31-400b-8ce1-bf1230143a6a for instance 349b3f34-40ef-416e-a077-7cc112925c2b on user Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61421) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-106516bf-d579-44c5-8990-74f86fe2e542 req-76bb9200-6443-4565-ac61-3de0418f8f3c service nova] Acquired lock "compute-rpcapi-router" {{(pid=61421) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:53 user devstack@n-api.service[61421]: INFO nova.compute.rpcapi [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 20:09:53 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] Releasing lock "compute-rpcapi-router" {{(pid=61421) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 20:09:53 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-81d29ee1-8be1-4b5e-bb71-64190fec4b68 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172758 Apr 18 20:09:53 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 22/66] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:09:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:56 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-07cd6082-1050-4070-9b79-61071a34f0b9 req-dd41fcdf-c152-49b5-ae72-3447ba4b36c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-07cd6082-1050-4070-9b79-61071a34f0b9 req-dd41fcdf-c152-49b5-ae72-3447ba4b36c6 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-07cd6082-1050-4070-9b79-61071a34f0b9 req-dd41fcdf-c152-49b5-ae72-3447ba4b36c6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-07cd6082-1050-4070-9b79-61071a34f0b9 req-dd41fcdf-c152-49b5-ae72-3447ba4b36c6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:56 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-07cd6082-1050-4070-9b79-61071a34f0b9 req-dd41fcdf-c152-49b5-ae72-3447ba4b36c6 service nova] Creating event network-changed:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:09:56 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-07cd6082-1050-4070-9b79-61071a34f0b9 req-dd41fcdf-c152-49b5-ae72-3447ba4b36c6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041072 Apr 18 20:09:56 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 24/67] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-2eb7f99d-5259-46f3-a15d-9e4958f6172f req-b91c3ec6-c593-4d6d-a79c-fa85bd3ae296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2eb7f99d-5259-46f3-a15d-9e4958f6172f req-b91c3ec6-c593-4d6d-a79c-fa85bd3ae296 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2eb7f99d-5259-46f3-a15d-9e4958f6172f req-b91c3ec6-c593-4d6d-a79c-fa85bd3ae296 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2eb7f99d-5259-46f3-a15d-9e4958f6172f req-b91c3ec6-c593-4d6d-a79c-fa85bd3ae296 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-2eb7f99d-5259-46f3-a15d-9e4958f6172f req-b91c3ec6-c593-4d6d-a79c-fa85bd3ae296 service nova] Creating event network-changed:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:09:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-2eb7f99d-5259-46f3-a15d-9e4958f6172f req-b91c3ec6-c593-4d6d-a79c-fa85bd3ae296 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037312 Apr 18 20:09:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 22/68] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:09:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:09:58 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-6a1217ab-a084-416e-852d-17113db3fd67 req-28f63dd4-64fb-41fb-8a5c-f495d67fbf0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "name": "network-vif-plugged", "status": "completed", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:09:58 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-6a1217ab-a084-416e-852d-17113db3fd67 req-28f63dd4-64fb-41fb-8a5c-f495d67fbf0d service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:09:58 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-6a1217ab-a084-416e-852d-17113db3fd67 req-28f63dd4-64fb-41fb-8a5c-f495d67fbf0d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:09:58 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-6a1217ab-a084-416e-852d-17113db3fd67 req-28f63dd4-64fb-41fb-8a5c-f495d67fbf0d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:09:58 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-6a1217ab-a084-416e-852d-17113db3fd67 req-28f63dd4-64fb-41fb-8a5c-f495d67fbf0d service nova] Creating event network-vif-plugged:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:09:58 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-6a1217ab-a084-416e-852d-17113db3fd67 req-28f63dd4-64fb-41fb-8a5c-f495d67fbf0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032443 Apr 18 20:09:58 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 23/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:09:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:01 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=16 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:01 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "name": "network-vif-plugged", "status": "completed", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}, {"server_uuid": "cd9040f3-b694-4af2-9486-854bf4d3b037", "name": "network-vif-plugged", "status": "completed", "tag": "751bbee4-55f7-4cb4-96f9-a760cfa4b240"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:01 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:01 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:01 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:01 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] Creating event network-vif-plugged:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:10:01 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] Creating event network-vif-plugged:751bbee4-55f7-4cb4-96f9-a760cfa4b240 for instance cd9040f3-b694-4af2-9486-854bf4d3b037 on user Apr 18 20:10:01 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-f0cdec37-07b2-413c-a93d-9b4c31a20b5d req-740e9b4c-40bd-46af-994a-1f51b3a51f48 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.048163 Apr 18 20:10:01 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 25/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:01 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=24 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-3bcba20b-4a83-4aeb-a7d2-090781edfc4b req-877f3540-4b8a-4b5b-90d5-de553f0f1c46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349b3f34-40ef-416e-a077-7cc112925c2b", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb2500-fd31-400b-8ce1-bf1230143a6a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3bcba20b-4a83-4aeb-a7d2-090781edfc4b req-877f3540-4b8a-4b5b-90d5-de553f0f1c46 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3bcba20b-4a83-4aeb-a7d2-090781edfc4b req-877f3540-4b8a-4b5b-90d5-de553f0f1c46 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3bcba20b-4a83-4aeb-a7d2-090781edfc4b req-877f3540-4b8a-4b5b-90d5-de553f0f1c46 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-3bcba20b-4a83-4aeb-a7d2-090781edfc4b req-877f3540-4b8a-4b5b-90d5-de553f0f1c46 service nova] Creating event network-vif-plugged:7dbb2500-fd31-400b-8ce1-bf1230143a6a for instance 349b3f34-40ef-416e-a077-7cc112925c2b on user Apr 18 20:10:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-3bcba20b-4a83-4aeb-a7d2-090781edfc4b req-877f3540-4b8a-4b5b-90d5-de553f0f1c46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039793 Apr 18 20:10:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 23/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:02 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-892d9d4f-3b1e-498e-8315-3017c66a8419 req-df7a8d59-29c2-4d83-bc6f-a0545927d9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "name": "network-vif-plugged", "status": "completed", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:02 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=12 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:02 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-892d9d4f-3b1e-498e-8315-3017c66a8419 req-df7a8d59-29c2-4d83-bc6f-a0545927d9a0 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:02 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-892d9d4f-3b1e-498e-8315-3017c66a8419 req-df7a8d59-29c2-4d83-bc6f-a0545927d9a0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:02 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-892d9d4f-3b1e-498e-8315-3017c66a8419 req-df7a8d59-29c2-4d83-bc6f-a0545927d9a0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:02 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-892d9d4f-3b1e-498e-8315-3017c66a8419 req-df7a8d59-29c2-4d83-bc6f-a0545927d9a0 service nova] Creating event network-vif-plugged:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:10:02 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-892d9d4f-3b1e-498e-8315-3017c66a8419 req-df7a8d59-29c2-4d83-bc6f-a0545927d9a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068149 Apr 18 20:10:02 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 24/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:03 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:03 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-fe74cfa5-2c07-496d-9694-6a45123425ba req-9dfffa22-4826-4923-b6d2-64fceaafd384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9040f3-b694-4af2-9486-854bf4d3b037", "name": "network-vif-plugged", "status": "completed", "tag": "751bbee4-55f7-4cb4-96f9-a760cfa4b240"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:03 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fe74cfa5-2c07-496d-9694-6a45123425ba req-9dfffa22-4826-4923-b6d2-64fceaafd384 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:03 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fe74cfa5-2c07-496d-9694-6a45123425ba req-9dfffa22-4826-4923-b6d2-64fceaafd384 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:03 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fe74cfa5-2c07-496d-9694-6a45123425ba req-9dfffa22-4826-4923-b6d2-64fceaafd384 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:03 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-fe74cfa5-2c07-496d-9694-6a45123425ba req-9dfffa22-4826-4923-b6d2-64fceaafd384 service nova] Creating event network-vif-plugged:751bbee4-55f7-4cb4-96f9-a760cfa4b240 for instance cd9040f3-b694-4af2-9486-854bf4d3b037 on user Apr 18 20:10:03 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-fe74cfa5-2c07-496d-9694-6a45123425ba req-9dfffa22-4826-4923-b6d2-64fceaafd384 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062532 Apr 18 20:10:03 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 26/73] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:03 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-6ae7a1a0-84a8-4832-9bec-398fc0e66d93 req-9f48a6af-ba83-4b26-aafb-e83f6b94a7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349b3f34-40ef-416e-a077-7cc112925c2b", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb2500-fd31-400b-8ce1-bf1230143a6a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:03 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6ae7a1a0-84a8-4832-9bec-398fc0e66d93 req-9f48a6af-ba83-4b26-aafb-e83f6b94a7ef service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6ae7a1a0-84a8-4832-9bec-398fc0e66d93 req-9f48a6af-ba83-4b26-aafb-e83f6b94a7ef service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:03 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-6ae7a1a0-84a8-4832-9bec-398fc0e66d93 req-9f48a6af-ba83-4b26-aafb-e83f6b94a7ef service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-6ae7a1a0-84a8-4832-9bec-398fc0e66d93 req-9f48a6af-ba83-4b26-aafb-e83f6b94a7ef service nova] Creating event network-vif-plugged:7dbb2500-fd31-400b-8ce1-bf1230143a6a for instance 349b3f34-40ef-416e-a077-7cc112925c2b on user Apr 18 20:10:03 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-6ae7a1a0-84a8-4832-9bec-398fc0e66d93 req-9f48a6af-ba83-4b26-aafb-e83f6b94a7ef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069821 Apr 18 20:10:03 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 24/74] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:04 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:04 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-7a5799fb-35df-4596-b160-da23a76d463d req-1494d66f-3f4f-4079-8245-9ce5e162bd0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "name": "network-vif-plugged", "status": "completed", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:04 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-7a5799fb-35df-4596-b160-da23a76d463d req-1494d66f-3f4f-4079-8245-9ce5e162bd0b service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:04 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-7a5799fb-35df-4596-b160-da23a76d463d req-1494d66f-3f4f-4079-8245-9ce5e162bd0b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:04 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-7a5799fb-35df-4596-b160-da23a76d463d req-1494d66f-3f4f-4079-8245-9ce5e162bd0b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:04 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-7a5799fb-35df-4596-b160-da23a76d463d req-1494d66f-3f4f-4079-8245-9ce5e162bd0b service nova] Creating event network-vif-plugged:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:10:04 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-7a5799fb-35df-4596-b160-da23a76d463d req-1494d66f-3f4f-4079-8245-9ce5e162bd0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076555 Apr 18 20:10:04 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 27/75] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:05 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-615d839a-56d1-4693-9fea-54d3b7a11371 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Action: 'create', calling method: .version_select at 0x7fb7745b3880>, body: {"keypair": {"name": "tempest-keypair-1851809297", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKltnJHAzK9DxkKk+QDhFAZGvmB2SxGi08D4W1h12pkHIo+LRg4o49ro06innJlcoyEcsov8Uj64FKFY8CO/fKmD1N4Oh/+hX8tumlIeCyjYmMiicwqNN17WpCGNP03gQ=="}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:05 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-615d839a-56d1-4693-9fea-54d3b7a11371 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Getting quotas for project da5a7248acf744b1b289c36e0d684b9c. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:05 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-615d839a-56d1-4693-9fea-54d3b7a11371 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Getting quotas for user 3aa0db0e3abe4c74b549c7051a97a3fc and project da5a7248acf744b1b289c36e0d684b9c. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:05 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-615d839a-56d1-4693-9fea-54d3b7a11371 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.493921 Apr 18 20:10:05 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 25/76] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:10:04 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "name": "network-vif-plugged", "status": "completed", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}, {"server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "name": "network-vif-plugged", "status": "completed", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] Creating event network-vif-plugged:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:10:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] Creating event network-vif-plugged:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:10:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-7c4ce933-a1c0-45b9-9808-7b7d70abfdcf req-a249c4d4-8900-43c2-a84c-d70d5ba4146e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.081133 Apr 18 20:10:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:08 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1683141821", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "0b439498-22c0-438b-a628-11174b033e3e"}], "security_groups": [{"name": "tempest-securitygroup--337426214"}], "key_name": "tempest-keypair-1851809297", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:08 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] validate_networks() for [('0b439498-22c0-438b-a628-11174b033e3e', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Getting quotas for project da5a7248acf744b1b289c36e0d684b9c. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Getting quotas for user 3aa0db0e3abe4c74b549c7051a97a3fc and project da5a7248acf744b1b289c36e0d684b9c. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:10:11 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:10:11 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-025b1f43-7721-4a88-ab63-bab1158c01b0 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 3.699570 Apr 18 20:10:11 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 28/78] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:10:08 2023] POST /compute/v2.1/servers => generated 403 bytes in 3702 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:10:11 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-f24e7f3c-181f-469c-b236-1858102a7f33 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:11 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-f24e7f3c-181f-469c-b236-1858102a7f33 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:11 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-f24e7f3c-181f-469c-b236-1858102a7f33 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa0db0e3abe4c74b549c7051a97a3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5a7248acf744b1b289c36e0d684b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:11 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-f24e7f3c-181f-469c-b236-1858102a7f33 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105" status: 200 len: 1236 microversion: 2.1 time: 0.178553 Apr 18 20:10:11 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:11 2023] GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105 => generated 1236 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:10:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=20 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:17 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-477cb7b6-0801-41c6-a2ee-f2b3186e9ffb req-2bec5272-95f0-4eaf-b897-70bfe4236868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=8 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-477cb7b6-0801-41c6-a2ee-f2b3186e9ffb req-2bec5272-95f0-4eaf-b897-70bfe4236868 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-477cb7b6-0801-41c6-a2ee-f2b3186e9ffb req-2bec5272-95f0-4eaf-b897-70bfe4236868 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-477cb7b6-0801-41c6-a2ee-f2b3186e9ffb req-2bec5272-95f0-4eaf-b897-70bfe4236868 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=17 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:17 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-477cb7b6-0801-41c6-a2ee-f2b3186e9ffb req-2bec5272-95f0-4eaf-b897-70bfe4236868 service nova] Creating event network-changed:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:10:17 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-477cb7b6-0801-41c6-a2ee-f2b3186e9ffb req-2bec5272-95f0-4eaf-b897-70bfe4236868 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074220 Apr 18 20:10:17 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 29/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-24bb1729-0d54-4035-9458-b62ddaf48c81 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Action: 'create', calling method: .version_select at 0x7fb7745afd00>, body: {"keypair": {"name": "tempest-keypair-1244138421", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCluJu46Mp3X6hj1W6WLaRuSBR/cVIyuBhfYusFwdU4934l16Gixpg5yNaFOdAK0heGijC7mLxxnnJS4UbjZzQasH2R97yGenm1HvXY1dzC6RPnUDfG7OZ5SuwvP7vuWA=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:17 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-24bb1729-0d54-4035-9458-b62ddaf48c81 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Getting quotas for project 31f789b31b9540e99ec1a3eb3fe2f384. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:17 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-24bb1729-0d54-4035-9458-b62ddaf48c81 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Getting quotas for user d50df8fc3c7b45aab932122e3131d101 and project 31f789b31b9540e99ec1a3eb3fe2f384. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-24bb1729-0d54-4035-9458-b62ddaf48c81 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.537397 Apr 18 20:10:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 26/81] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:10:16 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:10:20 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-d720e653-b3f5-4122-b7bb-fe24dd1d70dd req-58aae5a4-f3f9-4f97-a11e-6307ee43eabe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "name": "network-vif-plugged", "status": "completed", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:20 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=8 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:20 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d720e653-b3f5-4122-b7bb-fe24dd1d70dd req-58aae5a4-f3f9-4f97-a11e-6307ee43eabe service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d720e653-b3f5-4122-b7bb-fe24dd1d70dd req-58aae5a4-f3f9-4f97-a11e-6307ee43eabe service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d720e653-b3f5-4122-b7bb-fe24dd1d70dd req-58aae5a4-f3f9-4f97-a11e-6307ee43eabe service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:20 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-d720e653-b3f5-4122-b7bb-fe24dd1d70dd req-58aae5a4-f3f9-4f97-a11e-6307ee43eabe service nova] Creating event network-vif-plugged:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:10:20 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-d720e653-b3f5-4122-b7bb-fe24dd1d70dd req-58aae5a4-f3f9-4f97-a11e-6307ee43eabe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070909 Apr 18 20:10:20 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 27/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:20 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-674607723", "imageRef": "e1bc0260-0c14-4f13-8da6-8bd7fb1b7826", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "e348b497-27b7-42e4-a654-50dddf9a68e8"}], "security_groups": [{"name": "tempest-securitygroup--1716337584"}], "key_name": "tempest-keypair-1244138421", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:20 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] validate_networks() for [('e348b497-27b7-42e4-a654-50dddf9a68e8', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Getting quotas for project 31f789b31b9540e99ec1a3eb3fe2f384. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Getting quotas for user d50df8fc3c7b45aab932122e3131d101 and project 31f789b31b9540e99ec1a3eb3fe2f384. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:10:21 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='e1bc0260-0c14-4f13-8da6-8bd7fb1b7826',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:10:21 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-920590c0-49bd-4d07-8a37-781af3ef845f tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.855116 Apr 18 20:10:21 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 30/83] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:10:20 2023] POST /compute/v2.1/servers => generated 404 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:10:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2e5d0571-d43c-4fbf-993f-607a82fda69d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:21 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2e5d0571-d43c-4fbf-993f-607a82fda69d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:21 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-2e5d0571-d43c-4fbf-993f-607a82fda69d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50df8fc3c7b45aab932122e3131d101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f789b31b9540e99ec1a3eb3fe2f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2e5d0571-d43c-4fbf-993f-607a82fda69d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 200 len: 1239 microversion: 2.1 time: 0.093931 Apr 18 20:10:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 27/84] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:21 2023] GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:10:22 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:22 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-b2e2f718-cfc6-4df7-a076-81d63b04d3c5 req-d4997b0c-afa9-4e92-856d-df8689dbd968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "name": "network-vif-plugged", "status": "completed", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b2e2f718-cfc6-4df7-a076-81d63b04d3c5 req-d4997b0c-afa9-4e92-856d-df8689dbd968 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b2e2f718-cfc6-4df7-a076-81d63b04d3c5 req-d4997b0c-afa9-4e92-856d-df8689dbd968 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b2e2f718-cfc6-4df7-a076-81d63b04d3c5 req-d4997b0c-afa9-4e92-856d-df8689dbd968 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:22 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-b2e2f718-cfc6-4df7-a076-81d63b04d3c5 req-d4997b0c-afa9-4e92-856d-df8689dbd968 service nova] Creating event network-vif-plugged:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:10:22 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-b2e2f718-cfc6-4df7-a076-81d63b04d3c5 req-d4997b0c-afa9-4e92-856d-df8689dbd968 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044193 Apr 18 20:10:22 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 28/85] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:26 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-791aa8d3-f8fd-41ca-b542-60f774bf1000 req-37d04370-f42d-40ac-b0c3-467eba973eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:26 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-791aa8d3-f8fd-41ca-b542-60f774bf1000 req-37d04370-f42d-40ac-b0c3-467eba973eba service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:26 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-791aa8d3-f8fd-41ca-b542-60f774bf1000 req-37d04370-f42d-40ac-b0c3-467eba973eba service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:26 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-791aa8d3-f8fd-41ca-b542-60f774bf1000 req-37d04370-f42d-40ac-b0c3-467eba973eba service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:26 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-791aa8d3-f8fd-41ca-b542-60f774bf1000 req-37d04370-f42d-40ac-b0c3-467eba973eba service nova] Creating event network-changed:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:10:26 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-791aa8d3-f8fd-41ca-b542-60f774bf1000 req-37d04370-f42d-40ac-b0c3-467eba973eba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042482 Apr 18 20:10:26 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 31/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:26 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5be535a3-6c63-46ad-8eaa-0461cfa8edd8 req-896e2ac1-3d5e-4ef3-b74b-5ee5e9ea3ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "name": "network-vif-plugged", "status": "completed", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5be535a3-6c63-46ad-8eaa-0461cfa8edd8 req-896e2ac1-3d5e-4ef3-b74b-5ee5e9ea3ca5 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5be535a3-6c63-46ad-8eaa-0461cfa8edd8 req-896e2ac1-3d5e-4ef3-b74b-5ee5e9ea3ca5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5be535a3-6c63-46ad-8eaa-0461cfa8edd8 req-896e2ac1-3d5e-4ef3-b74b-5ee5e9ea3ca5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5be535a3-6c63-46ad-8eaa-0461cfa8edd8 req-896e2ac1-3d5e-4ef3-b74b-5ee5e9ea3ca5 service nova] Creating event network-vif-plugged:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:10:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5be535a3-6c63-46ad-8eaa-0461cfa8edd8 req-896e2ac1-3d5e-4ef3-b74b-5ee5e9ea3ca5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046830 Apr 18 20:10:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:30 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-828b82ca-9524-4f69-8385-0fff07008b6b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Action: 'create', calling method: .version_select at 0x7fb7745b3b50>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2141294217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHQQo7esqxJLw5Qmh574XFT3+MmOw5qslgnrqyvKJZMTjmftcngKX2MXF+hIrvR5OALpXPB0qzdvtut3u2HyBVyXqwFG8Uh5XdrpGLBKXZT1TRfJLGphZEpwMB/JZkVOgg=="}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:30 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-828b82ca-9524-4f69-8385-0fff07008b6b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:30 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-828b82ca-9524-4f69-8385-0fff07008b6b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for user 48ac512f13754a49bde814ba9e7103ed and project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-828b82ca-9524-4f69-8385-0fff07008b6b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.067267 Apr 18 20:10:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 29/88] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:10:30 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-890873915", "imageRef": "3d516e56-d1df-4b1b-8ee8-ba66c1013995", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-2141294217", "networks": [{"uuid": "4701fbad-415a-40b8-afc1-2a18650aa308"}]}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] validate_networks() for [('4701fbad-415a-40b8-afc1-2a18650aa308', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for user 48ac512f13754a49bde814ba9e7103ed and project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:30 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:10:31 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3d516e56-d1df-4b1b-8ee8-ba66c1013995',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:10:31 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-cae9adfa-4d2f-44b8-8055-d3143f11b228 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.650891 Apr 18 20:10:31 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 32/89] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:10:30 2023] POST /compute/v2.1/servers => generated 378 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:10:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-17e99684-ea08-4cc9-b4a2-ef2db4fe0a62 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-17e99684-ea08-4cc9-b4a2-ef2db4fe0a62 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:31 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-17e99684-ea08-4cc9-b4a2-ef2db4fe0a62 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-17e99684-ea08-4cc9-b4a2-ef2db4fe0a62 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 200 len: 1252 microversion: 2.1 time: 0.082343 Apr 18 20:10:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 29/90] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:31 2023] GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 1252 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:10:31 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-1536253a-50a2-4cea-a985-342e9482397e req-52fb0a14-52e0-48e1-9787-9e1a273ae3cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "name": "network-vif-plugged", "status": "completed", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-1536253a-50a2-4cea-a985-342e9482397e req-52fb0a14-52e0-48e1-9787-9e1a273ae3cc service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-1536253a-50a2-4cea-a985-342e9482397e req-52fb0a14-52e0-48e1-9787-9e1a273ae3cc service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-1536253a-50a2-4cea-a985-342e9482397e req-52fb0a14-52e0-48e1-9787-9e1a273ae3cc service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:31 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-1536253a-50a2-4cea-a985-342e9482397e req-52fb0a14-52e0-48e1-9787-9e1a273ae3cc service nova] Creating event network-vif-plugged:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:10:31 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-1536253a-50a2-4cea-a985-342e9482397e req-52fb0a14-52e0-48e1-9787-9e1a273ae3cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049350 Apr 18 20:10:31 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 30/91] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:33 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:33 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-b9b714af-791a-46e0-a150-b9a8420406f9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b" status: 200 len: 1692 microversion: 2.87 time: 0.561808 Apr 18 20:10:33 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 33/92] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:10:33 2023] GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b => generated 1692 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:10:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b3bab4b8-6318-4ea4-82f2-8fa9b632549d tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Action: 'create', calling method: .version_select at 0x7fb773c79900>, body: {"keypair": {"name": "tempest-keypair-208135863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI37mP10EobJ+RyjjJI6oKIQYIodWv/4+FFqXTP7oK0UGDF+yx+haA8NfHNfu0byf0i4E0XEQIeh91Lv0/WhN2818SRHQCXrLyqf0O/HB7Ddm1LiZ7olMDOEZ8pcUC4UEQ=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:35 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-b3bab4b8-6318-4ea4-82f2-8fa9b632549d tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Getting quotas for project 6e40bd5776b645d0b587b8aac24953c9. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:35 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-b3bab4b8-6318-4ea4-82f2-8fa9b632549d tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Getting quotas for user a14239df813d442792ffabf053449b8a and project 6e40bd5776b645d0b587b8aac24953c9. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b3bab4b8-6318-4ea4-82f2-8fa9b632549d tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.235122 Apr 18 20:10:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 30/93] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:10:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:36 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-872a3d3b-06b1-4970-be06-141eb1889156 req-f023ca12-de5b-4f92-959f-ecac286d0c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c48b2c8a-5d24-400c-b01e-cb285312e887", "tag": "7cfe4735-5ac2-432f-aab8-3dd6330d3de2"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:36 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-872a3d3b-06b1-4970-be06-141eb1889156 req-f023ca12-de5b-4f92-959f-ecac286d0c89 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:36 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-872a3d3b-06b1-4970-be06-141eb1889156 req-f023ca12-de5b-4f92-959f-ecac286d0c89 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:36 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-872a3d3b-06b1-4970-be06-141eb1889156 req-f023ca12-de5b-4f92-959f-ecac286d0c89 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:36 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-872a3d3b-06b1-4970-be06-141eb1889156 req-f023ca12-de5b-4f92-959f-ecac286d0c89 service nova] Creating event network-changed:7cfe4735-5ac2-432f-aab8-3dd6330d3de2 for instance c48b2c8a-5d24-400c-b01e-cb285312e887 on user Apr 18 20:10:36 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-872a3d3b-06b1-4970-be06-141eb1889156 req-f023ca12-de5b-4f92-959f-ecac286d0c89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065760 Apr 18 20:10:36 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 34/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:36 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81ab9b2da4cd6b75e87c5085cfd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dfb775be64f09ad5d908edb15e484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:36 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-26c0fe7c-1234-4583-a5ce-aca43400eb6c tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037" status: 200 len: 1490 microversion: 2.1 time: 0.663651 Apr 18 20:10:36 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:35 2023] GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037 => generated 1490 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 20:10:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1645171154", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "8885c94e-39f6-4cde-9f6a-aecd0683c3ad"}], "security_groups": [{"name": "tempest-securitygroup--176904959"}], "key_name": "tempest-keypair-208135863", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:37 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] validate_networks() for [('8885c94e-39f6-4cde-9f6a-aecd0683c3ad', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Getting quotas for project 6e40bd5776b645d0b587b8aac24953c9. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Getting quotas for user a14239df813d442792ffabf053449b8a and project 6e40bd5776b645d0b587b8aac24953c9. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:10:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-05f048ea-fb76-48d2-ac64-a45d3bb39611 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.612545 Apr 18 20:10:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 31/96] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:10:37 2023] POST /compute/v2.1/servers => generated 406 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2f2c5a7d-bda5-4fe7-b42e-c721079abe16 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-2f2c5a7d-bda5-4fe7-b42e-c721079abe16 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-2f2c5a7d-bda5-4fe7-b42e-c721079abe16 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-2f2c5a7d-bda5-4fe7-b42e-c721079abe16 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1232 microversion: 2.1 time: 0.083195 Apr 18 20:10:38 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 35/97] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:38 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f19bcf69a6c4abca9f0744965a79d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1c758096d340d5bc72df80fae46f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:38 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-01272d57-6aaf-47c1-8188-be59ee9369fe tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 200 len: 1550 microversion: 2.1 time: 0.268705 Apr 18 20:10:38 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 32/98] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:38 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 1550 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-3949f835-6ff6-419f-8293-0af8e10ed561 req-17529671-fe4f-47bf-8fb9-aa7b83d62f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b2c8a-5d24-400c-b01e-cb285312e887", "name": "network-vif-plugged", "status": "completed", "tag": "7cfe4735-5ac2-432f-aab8-3dd6330d3de2"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3949f835-6ff6-419f-8293-0af8e10ed561 req-17529671-fe4f-47bf-8fb9-aa7b83d62f47 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3949f835-6ff6-419f-8293-0af8e10ed561 req-17529671-fe4f-47bf-8fb9-aa7b83d62f47 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3949f835-6ff6-419f-8293-0af8e10ed561 req-17529671-fe4f-47bf-8fb9-aa7b83d62f47 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-3949f835-6ff6-419f-8293-0af8e10ed561 req-17529671-fe4f-47bf-8fb9-aa7b83d62f47 service nova] Creating event network-vif-plugged:7cfe4735-5ac2-432f-aab8-3dd6330d3de2 for instance c48b2c8a-5d24-400c-b01e-cb285312e887 on user Apr 18 20:10:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-3949f835-6ff6-419f-8293-0af8e10ed561 req-17529671-fe4f-47bf-8fb9-aa7b83d62f47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073896 Apr 18 20:10:38 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 36/99] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:38 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621a49d58c34c948ee000a94751a585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4584427b930494cbce6719967c325da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-43adc6ca-24d9-49bd-a9f3-356a29fe3f71 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 200 len: 1535 microversion: 2.1 time: 0.407413 Apr 18 20:10:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 32/100] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:10:38 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 1535 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:10:41 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-cd57d5ff-a4d1-44f2-926b-5a6b7955d6a1 req-d13c73aa-bf25-4e08-bdda-db63485eae0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b2c8a-5d24-400c-b01e-cb285312e887", "name": "network-vif-plugged", "status": "completed", "tag": "7cfe4735-5ac2-432f-aab8-3dd6330d3de2"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:41 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-cd57d5ff-a4d1-44f2-926b-5a6b7955d6a1 req-d13c73aa-bf25-4e08-bdda-db63485eae0b service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-cd57d5ff-a4d1-44f2-926b-5a6b7955d6a1 req-d13c73aa-bf25-4e08-bdda-db63485eae0b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-cd57d5ff-a4d1-44f2-926b-5a6b7955d6a1 req-d13c73aa-bf25-4e08-bdda-db63485eae0b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-cd57d5ff-a4d1-44f2-926b-5a6b7955d6a1 req-d13c73aa-bf25-4e08-bdda-db63485eae0b service nova] Creating event network-vif-plugged:7cfe4735-5ac2-432f-aab8-3dd6330d3de2 for instance c48b2c8a-5d24-400c-b01e-cb285312e887 on user Apr 18 20:10:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-cd57d5ff-a4d1-44f2-926b-5a6b7955d6a1 req-d13c73aa-bf25-4e08-bdda-db63485eae0b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047266 Apr 18 20:10:41 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:41 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:10:41 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-3b8aa84c-e511-433c-97f2-ebe9fa506cf3 req-ef38ec22-2e7f-4a95-bfde-aadf701f95c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3b8aa84c-e511-433c-97f2-ebe9fa506cf3 req-ef38ec22-2e7f-4a95-bfde-aadf701f95c4 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3b8aa84c-e511-433c-97f2-ebe9fa506cf3 req-ef38ec22-2e7f-4a95-bfde-aadf701f95c4 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3b8aa84c-e511-433c-97f2-ebe9fa506cf3 req-ef38ec22-2e7f-4a95-bfde-aadf701f95c4 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-3b8aa84c-e511-433c-97f2-ebe9fa506cf3 req-ef38ec22-2e7f-4a95-bfde-aadf701f95c4 service nova] Creating event network-changed:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:10:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-3b8aa84c-e511-433c-97f2-ebe9fa506cf3 req-ef38ec22-2e7f-4a95-bfde-aadf701f95c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050057 Apr 18 20:10:41 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 37/102] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:41 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:10:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d058e39b-b9fa-452d-9f43-4a651d6f80d9 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 200 len: 1586 microversion: 2.20 time: 0.398062 Apr 18 20:10:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 33/103] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:10:41 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 1586 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:10:44 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-8f78b885-fcad-4f6b-b67b-e244f9acf7e4 req-7d58f282-9b2f-47cf-a5ec-5d2d466d9a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "name": "network-vif-plugged", "status": "completed", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8f78b885-fcad-4f6b-b67b-e244f9acf7e4 req-7d58f282-9b2f-47cf-a5ec-5d2d466d9a55 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8f78b885-fcad-4f6b-b67b-e244f9acf7e4 req-7d58f282-9b2f-47cf-a5ec-5d2d466d9a55 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8f78b885-fcad-4f6b-b67b-e244f9acf7e4 req-7d58f282-9b2f-47cf-a5ec-5d2d466d9a55 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:44 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-8f78b885-fcad-4f6b-b67b-e244f9acf7e4 req-7d58f282-9b2f-47cf-a5ec-5d2d466d9a55 service nova] Creating event network-vif-plugged:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:10:44 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-8f78b885-fcad-4f6b-b67b-e244f9acf7e4 req-7d58f282-9b2f-47cf-a5ec-5d2d466d9a55 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 Apr 18 20:10:44 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 34/104] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:10:46 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-5c4e6660-472d-4517-ab7c-6ce80c3f24a3 req-d7fcccd8-5d38-4ee2-99f2-b96eaa6350b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "name": "network-vif-plugged", "status": "completed", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:10:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-5c4e6660-472d-4517-ab7c-6ce80c3f24a3 req-d7fcccd8-5d38-4ee2-99f2-b96eaa6350b7 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:10:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-5c4e6660-472d-4517-ab7c-6ce80c3f24a3 req-d7fcccd8-5d38-4ee2-99f2-b96eaa6350b7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:10:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-5c4e6660-472d-4517-ab7c-6ce80c3f24a3 req-d7fcccd8-5d38-4ee2-99f2-b96eaa6350b7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:10:46 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-5c4e6660-472d-4517-ab7c-6ce80c3f24a3 req-d7fcccd8-5d38-4ee2-99f2-b96eaa6350b7 service nova] Creating event network-vif-plugged:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:10:46 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-5c4e6660-472d-4517-ab7c-6ce80c3f24a3 req-d7fcccd8-5d38-4ee2-99f2-b96eaa6350b7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030671 Apr 18 20:10:46 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 38/105] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:10:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=18 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=16 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:02 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa0db0e3abe4c74b549c7051a97a3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5a7248acf744b1b289c36e0d684b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-74039556-4ffb-4acb-b5bc-3245a3a3f4bd tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105" status: 200 len: 1544 microversion: 2.1 time: 0.449818 Apr 18 20:11:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 34/106] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:11:02 2023] GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105 => generated 1544 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=22 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:12 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50df8fc3c7b45aab932122e3131d101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f789b31b9540e99ec1a3eb3fe2f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:12 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-d16eb763-f8c0-4700-bbbc-2706c15ebf1c tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 200 len: 1549 microversion: 2.1 time: 0.232270 Apr 18 20:11:12 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:11:11 2023] GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 1549 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=20 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=21 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:21 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:21 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-cff40940-fdde-471d-bd44-18c2bef17e3f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 200 len: 1537 microversion: 2.1 time: 0.262574 Apr 18 20:11:21 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 39/108] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:11:21 2023] GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:28 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2b4971f6-5812-4f41-b61f-108d60046e57 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1538 microversion: 2.1 time: 0.227802 Apr 18 20:11:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 35/109] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:11:28 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1538 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-709139635"}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-75d72084-894b-4ba9-bf9d-9139520bbae0 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "POST /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b/action" status: 202 len: 52 microversion: 2.87 time: 0.908790 Apr 18 20:11:34 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 36/110] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 20:11:33 2023] POST /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b/action => generated 52 bytes in 911 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:11:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-d7e1551f-a9ef-4253-93e5-f06987461fce tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037" status: 204 len: 0 microversion: 2.1 time: 0.379300 Apr 18 20:11:38 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 40/111] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:11:38 2023] DELETE /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fda81ab9b2da4cd6b75e87c5085cfd1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496dfb775be64f09ad5d908edb15e484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e8cc47ca-4e9a-493f-aefc-8606f5580f08 tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037" status: 200 len: 1496 microversion: 2.1 time: 0.388020 Apr 18 20:11:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 36/112] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:11:38 2023] GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037 => generated 1496 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-d6dd0157-23ad-46b5-a398-1eca04056d94 req-aaee46e9-c9ee-4a8a-bd93-4b620fc99426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9040f3-b694-4af2-9486-854bf4d3b037", "name": "network-vif-unplugged", "status": "completed", "tag": "751bbee4-55f7-4cb4-96f9-a760cfa4b240"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-d6dd0157-23ad-46b5-a398-1eca04056d94 req-aaee46e9-c9ee-4a8a-bd93-4b620fc99426 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-d6dd0157-23ad-46b5-a398-1eca04056d94 req-aaee46e9-c9ee-4a8a-bd93-4b620fc99426 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:38 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-d6dd0157-23ad-46b5-a398-1eca04056d94 req-aaee46e9-c9ee-4a8a-bd93-4b620fc99426 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-d6dd0157-23ad-46b5-a398-1eca04056d94 req-aaee46e9-c9ee-4a8a-bd93-4b620fc99426 service nova] Creating event network-vif-unplugged:751bbee4-55f7-4cb4-96f9-a760cfa4b240 for instance cd9040f3-b694-4af2-9486-854bf4d3b037 on user Apr 18 20:11:38 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-d6dd0157-23ad-46b5-a398-1eca04056d94 req-aaee46e9-c9ee-4a8a-bd93-4b620fc99426 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056732 Apr 18 20:11:38 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 41/113] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:39 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-07920b27-f149-45c6-891b-3b0539098323 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.684477 Apr 18 20:11:39 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 37/114] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:11:38 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c/os-interface => generated 282 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:11:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0ec1290e-0714-4454-87fe-5684c753b8c9 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.676719 Apr 18 20:11:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 37/115] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:11:39 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656/os-interface => generated 282 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:39 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-8acc2dd1-fbbf-4408-a775-aee45b1522fc req-78efb3d6-7491-4200-8dc8-d689ed127b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9040f3-b694-4af2-9486-854bf4d3b037", "name": "network-vif-deleted", "tag": "751bbee4-55f7-4cb4-96f9-a760cfa4b240"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-8acc2dd1-fbbf-4408-a775-aee45b1522fc req-78efb3d6-7491-4200-8dc8-d689ed127b86 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-8acc2dd1-fbbf-4408-a775-aee45b1522fc req-78efb3d6-7491-4200-8dc8-d689ed127b86 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-8acc2dd1-fbbf-4408-a775-aee45b1522fc req-78efb3d6-7491-4200-8dc8-d689ed127b86 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-8acc2dd1-fbbf-4408-a775-aee45b1522fc req-78efb3d6-7491-4200-8dc8-d689ed127b86 service nova] Creating event network-vif-deleted:751bbee4-55f7-4cb4-96f9-a760cfa4b240 for instance cd9040f3-b694-4af2-9486-854bf4d3b037 on user Apr 18 20:11:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-8acc2dd1-fbbf-4408-a775-aee45b1522fc req-78efb3d6-7491-4200-8dc8-d689ed127b86 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044824 Apr 18 20:11:39 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 42/116] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:40 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:40 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:40 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:40 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-e7c9af29-b453-4575-9b30-7deecd25efe6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b" status: 200 len: 1692 microversion: 2.87 time: 0.700326 Apr 18 20:11:40 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 38/117] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:11:39 2023] GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b => generated 1692 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:11:40 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5535b19a-4952-4c55-a47e-3a94014f1308 req-b0eae258-eadd-4a69-8553-cb7103150ffb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5535b19a-4952-4c55-a47e-3a94014f1308 req-b0eae258-eadd-4a69-8553-cb7103150ffb service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5535b19a-4952-4c55-a47e-3a94014f1308 req-b0eae258-eadd-4a69-8553-cb7103150ffb service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:40 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5535b19a-4952-4c55-a47e-3a94014f1308 req-b0eae258-eadd-4a69-8553-cb7103150ffb service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5535b19a-4952-4c55-a47e-3a94014f1308 req-b0eae258-eadd-4a69-8553-cb7103150ffb service nova] Creating event network-changed:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:11:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5535b19a-4952-4c55-a47e-3a94014f1308 req-b0eae258-eadd-4a69-8553-cb7103150ffb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027902 Apr 18 20:11:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 38/118] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1311991640"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:40 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:41 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-5d0c3133-54f0-4b65-8fd1-4c07d9c95ae0 req-8ac0b031-e325-4c48-935c-127bb751c0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd9040f3-b694-4af2-9486-854bf4d3b037", "name": "network-vif-plugged", "status": "completed", "tag": "751bbee4-55f7-4cb4-96f9-a760cfa4b240"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-5d0c3133-54f0-4b65-8fd1-4c07d9c95ae0 req-8ac0b031-e325-4c48-935c-127bb751c0aa service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-5d0c3133-54f0-4b65-8fd1-4c07d9c95ae0 req-8ac0b031-e325-4c48-935c-127bb751c0aa service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-5d0c3133-54f0-4b65-8fd1-4c07d9c95ae0 req-8ac0b031-e325-4c48-935c-127bb751c0aa service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-5d0c3133-54f0-4b65-8fd1-4c07d9c95ae0 req-8ac0b031-e325-4c48-935c-127bb751c0aa service nova] Creating event network-vif-plugged:751bbee4-55f7-4cb4-96f9-a760cfa4b240 for instance cd9040f3-b694-4af2-9486-854bf4d3b037 on user Apr 18 20:11:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-5d0c3133-54f0-4b65-8fd1-4c07d9c95ae0 req-8ac0b031-e325-4c48-935c-127bb751c0aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037588 Apr 18 20:11:41 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b3baf4c9-31bb-418b-9821-d8b10a4435db tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656/ips" status: 200 len: 103 microversion: 2.1 time: 0.042507 Apr 18 20:11:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 39/120] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:11:41 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656/ips => generated 103 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-36b359d5-8f96-44a1-871b-af4c19f63b0f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c/action" status: 202 len: 0 microversion: 2.1 time: 0.803135 Apr 18 20:11:41 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 43/121] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 20:11:40 2023] POST /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c/action => generated 0 bytes in 805 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 20:11:41 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-aa133b62-3f2e-4f10-b75a-a7c66b65abef tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '.version_select at 0x7fb7745fe3b0>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-aa133b62-3f2e-4f10-b75a-a7c66b65abef tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847" status: 200 len: 1611 microversion: 2.1 time: 0.055413 Apr 18 20:11:41 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 40/122] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 20:11:41 2023] GET /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847 => generated 1611 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-4e5ac6f8-336e-45e0-995a-836885a0619c req-49e37711-1f15-4bdb-ab80-700948a99cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-4e5ac6f8-336e-45e0-995a-836885a0619c req-49e37711-1f15-4bdb-ab80-700948a99cf6 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-4e5ac6f8-336e-45e0-995a-836885a0619c req-49e37711-1f15-4bdb-ab80-700948a99cf6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-4e5ac6f8-336e-45e0-995a-836885a0619c req-49e37711-1f15-4bdb-ab80-700948a99cf6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:42 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-4e5ac6f8-336e-45e0-995a-836885a0619c req-49e37711-1f15-4bdb-ab80-700948a99cf6 service nova] Creating event network-changed:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:11:42 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-4e5ac6f8-336e-45e0-995a-836885a0619c req-49e37711-1f15-4bdb-ab80-700948a99cf6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029037 Apr 18 20:11:42 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 44/123] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3abe18cc-5c6f-49a7-b5e7-2985e0c5614a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.180798 Apr 18 20:11:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 40/124] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 20:11:41 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0/os-interface => generated 282 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:42 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:11:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-bfdf3255-7e67-4a02-812d-a5616ae46812 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 204 len: 0 microversion: 2.1 time: 0.127877 Apr 18 20:11:42 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 41/125] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:11:42 2023] DELETE /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:43 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621a49d58c34c948ee000a94751a585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4584427b930494cbce6719967c325da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:43 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-2cdbfa05-95ed-4fa3-9233-3d94b948b1f8 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 200 len: 1541 microversion: 2.1 time: 0.620267 Apr 18 20:11:43 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 45/126] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:11:42 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 1541 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:11:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-3840edfe-57c3-4e71-86e6-21f42ede6ce2 req-0b1b4a11-9a71-42cf-80aa-77304f70e27e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "name": "network-vif-unplugged", "status": "completed", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3840edfe-57c3-4e71-86e6-21f42ede6ce2 req-0b1b4a11-9a71-42cf-80aa-77304f70e27e service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3840edfe-57c3-4e71-86e6-21f42ede6ce2 req-0b1b4a11-9a71-42cf-80aa-77304f70e27e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-3840edfe-57c3-4e71-86e6-21f42ede6ce2 req-0b1b4a11-9a71-42cf-80aa-77304f70e27e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-3840edfe-57c3-4e71-86e6-21f42ede6ce2 req-0b1b4a11-9a71-42cf-80aa-77304f70e27e service nova] Creating event network-vif-unplugged:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:11:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-3840edfe-57c3-4e71-86e6-21f42ede6ce2 req-0b1b4a11-9a71-42cf-80aa-77304f70e27e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030311 Apr 18 20:11:43 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 41/127] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:44 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:44 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-b0be82f5-59c5-4268-9fca-9e3be672d818 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0/ips" status: 200 len: 110 microversion: 2.20 time: 0.040776 Apr 18 20:11:44 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 42/128] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 20:11:44 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0/ips => generated 110 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:11:44 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-6271c06d-be08-4465-bb80-f5047748f8b7 req-5dd0cd04-cc4d-4f79-930b-a5049bae5f0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "name": "network-vif-deleted", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:44 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6271c06d-be08-4465-bb80-f5047748f8b7 req-5dd0cd04-cc4d-4f79-930b-a5049bae5f0c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:44 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6271c06d-be08-4465-bb80-f5047748f8b7 req-5dd0cd04-cc4d-4f79-930b-a5049bae5f0c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:44 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6271c06d-be08-4465-bb80-f5047748f8b7 req-5dd0cd04-cc4d-4f79-930b-a5049bae5f0c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:44 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6271c06d-be08-4465-bb80-f5047748f8b7 req-5dd0cd04-cc4d-4f79-930b-a5049bae5f0c service nova] Creating event network-vif-deleted:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:11:44 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-6271c06d-be08-4465-bb80-f5047748f8b7 req-5dd0cd04-cc4d-4f79-930b-a5049bae5f0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027236 Apr 18 20:11:44 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 46/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:45 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8764c1af-455f-4d21-9bd4-604ff561f656", "name": "network-vif-plugged", "status": "completed", "tag": "803faf14-85e4-4144-8dbc-2b674f420d43"}, {"name": "network-changed", "server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:45 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:45 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:45 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:45 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:11:45 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] Creating event network-vif-plugged:803faf14-85e4-4144-8dbc-2b674f420d43 for instance 8764c1af-455f-4d21-9bd4-604ff561f656 on user Apr 18 20:11:45 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] Creating event network-changed:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:11:45 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-be955109-ef01-426a-a730-2b6acca553dc req-cadcf785-7f98-484b-9105-0f18d7d88f06 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.036793 Apr 18 20:11:45 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 43/130] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:45 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:45 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-a389ceeb-0827-4a00-8b81-becaaae2ae0c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 204 len: 0 microversion: 2.20 time: 0.164910 Apr 18 20:11:45 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 42/131] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:11:45 2023] DELETE /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:45 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:11:45 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-58375bc1-711d-4e82-b812-33869bf6cb89 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 200 len: 1592 microversion: 2.20 time: 0.191335 Apr 18 20:11:45 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 47/132] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:11:45 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 1592 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:11:46 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "name": "network-vif-unplugged", "status": "completed", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}, {"server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "name": "network-vif-plugged", "status": "completed", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:46 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:46 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:46 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:46 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] Creating event network-vif-unplugged:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:11:46 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] Creating event network-vif-plugged:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:11:46 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-dfd9419c-469e-4bfa-85bb-254334267fa2 req-1b1b30ca-399c-4481-b159-2c8348897fb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030668 Apr 18 20:11:46 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 44/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:46 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:11:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-48089b14-227b-47fd-b63c-3a8f8753c418 req-ff5ac961-b5c8-4a92-8c15-911304972e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca4f2c5-3084-4356-b066-56c998d051d0", "name": "network-vif-deleted", "tag": "8866495c-b168-4aef-a0a2-53915dfa8ea9"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:11:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-48089b14-227b-47fd-b63c-3a8f8753c418 req-ff5ac961-b5c8-4a92-8c15-911304972e97 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:11:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-48089b14-227b-47fd-b63c-3a8f8753c418 req-ff5ac961-b5c8-4a92-8c15-911304972e97 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:11:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-48089b14-227b-47fd-b63c-3a8f8753c418 req-ff5ac961-b5c8-4a92-8c15-911304972e97 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:11:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-48089b14-227b-47fd-b63c-3a8f8753c418 req-ff5ac961-b5c8-4a92-8c15-911304972e97 service nova] Creating event network-vif-deleted:8866495c-b168-4aef-a0a2-53915dfa8ea9 for instance cca4f2c5-3084-4356-b066-56c998d051d0 on user Apr 18 20:11:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-48089b14-227b-47fd-b63c-3a8f8753c418 req-ff5ac961-b5c8-4a92-8c15-911304972e97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.026531 Apr 18 20:11:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 43/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:11:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:02 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:02 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-56d459a3-e860-4cc8-ae6c-f96b61723bd8 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.177864 Apr 18 20:12:02 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 48/135] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:12:02 2023] GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105/os-interface => generated 282 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:03 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:03 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:03 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-52852b35-63ec-48ff-bcb4-715c9e3f943e req-87013e52-02be-46fc-bc38-4476788d6d1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:03 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-52852b35-63ec-48ff-bcb4-715c9e3f943e req-87013e52-02be-46fc-bc38-4476788d6d1c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:03 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-52852b35-63ec-48ff-bcb4-715c9e3f943e req-87013e52-02be-46fc-bc38-4476788d6d1c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:03 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-52852b35-63ec-48ff-bcb4-715c9e3f943e req-87013e52-02be-46fc-bc38-4476788d6d1c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:03 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-52852b35-63ec-48ff-bcb4-715c9e3f943e req-87013e52-02be-46fc-bc38-4476788d6d1c service nova] Creating event network-changed:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:12:03 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-52852b35-63ec-48ff-bcb4-715c9e3f943e req-87013e52-02be-46fc-bc38-4476788d6d1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040220 Apr 18 20:12:03 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 45/136] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1353645351", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "0b439498-22c0-438b-a628-11174b033e3e"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] validate_networks() for [('0b439498-22c0-438b-a628-11174b033e3e', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Getting quotas for project da5a7248acf744b1b289c36e0d684b9c. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Getting quotas for user 3aa0db0e3abe4c74b549c7051a97a3fc and project da5a7248acf744b1b289c36e0d684b9c. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:12:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:12:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4839f4e9-0439-4f81-8aa5-7a177dbc6952 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.485773 Apr 18 20:12:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 44/137] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:12:05 2023] POST /compute/v2.1/servers => generated 378 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:12:05 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-d5e0adce-c5c2-4214-b06c-bdeb8a1eaead tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:05 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-d5e0adce-c5c2-4214-b06c-bdeb8a1eaead tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:05 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-d5e0adce-c5c2-4214-b06c-bdeb8a1eaead tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa0db0e3abe4c74b549c7051a97a3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5a7248acf744b1b289c36e0d684b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:05 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-d5e0adce-c5c2-4214-b06c-bdeb8a1eaead tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57" status: 200 len: 1212 microversion: 2.1 time: 0.062730 Apr 18 20:12:05 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 49/138] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:05 2023] GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57 => generated 1212 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:07 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-02254695-b09c-47ee-ac37-b6a6cddd1dee req-b1681824-882f-4f6e-a9db-e69f421e3b49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf1273ed-7fb4-4e81-90fe-576147c1be57", "tag": "86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:07 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-02254695-b09c-47ee-ac37-b6a6cddd1dee req-b1681824-882f-4f6e-a9db-e69f421e3b49 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:07 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-02254695-b09c-47ee-ac37-b6a6cddd1dee req-b1681824-882f-4f6e-a9db-e69f421e3b49 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:07 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-02254695-b09c-47ee-ac37-b6a6cddd1dee req-b1681824-882f-4f6e-a9db-e69f421e3b49 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:07 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-02254695-b09c-47ee-ac37-b6a6cddd1dee req-b1681824-882f-4f6e-a9db-e69f421e3b49 service nova] Creating event network-changed:86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5 for instance bf1273ed-7fb4-4e81-90fe-576147c1be57 on user Apr 18 20:12:07 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-02254695-b09c-47ee-ac37-b6a6cddd1dee req-b1681824-882f-4f6e-a9db-e69f421e3b49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027545 Apr 18 20:12:07 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 46/139] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ef40952d-80bb-4f17-9d31-2c7418615e57 req-c39152e8-dc0d-4778-8e37-b98c44f9fd45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1273ed-7fb4-4e81-90fe-576147c1be57", "name": "network-vif-plugged", "status": "completed", "tag": "86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ef40952d-80bb-4f17-9d31-2c7418615e57 req-c39152e8-dc0d-4778-8e37-b98c44f9fd45 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ef40952d-80bb-4f17-9d31-2c7418615e57 req-c39152e8-dc0d-4778-8e37-b98c44f9fd45 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ef40952d-80bb-4f17-9d31-2c7418615e57 req-c39152e8-dc0d-4778-8e37-b98c44f9fd45 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ef40952d-80bb-4f17-9d31-2c7418615e57 req-c39152e8-dc0d-4778-8e37-b98c44f9fd45 service nova] Creating event network-vif-plugged:86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5 for instance bf1273ed-7fb4-4e81-90fe-576147c1be57 on user Apr 18 20:12:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ef40952d-80bb-4f17-9d31-2c7418615e57 req-c39152e8-dc0d-4778-8e37-b98c44f9fd45 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031801 Apr 18 20:12:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:11 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-aa532bc6-e239-4fb3-ac59-bbaa3fdb1ae8 req-1439ab6c-af7a-467f-8b48-fed7ea42a42c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1273ed-7fb4-4e81-90fe-576147c1be57", "name": "network-vif-plugged", "status": "completed", "tag": "86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-aa532bc6-e239-4fb3-ac59-bbaa3fdb1ae8 req-1439ab6c-af7a-467f-8b48-fed7ea42a42c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-aa532bc6-e239-4fb3-ac59-bbaa3fdb1ae8 req-1439ab6c-af7a-467f-8b48-fed7ea42a42c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:11 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-aa532bc6-e239-4fb3-ac59-bbaa3fdb1ae8 req-1439ab6c-af7a-467f-8b48-fed7ea42a42c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:11 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-aa532bc6-e239-4fb3-ac59-bbaa3fdb1ae8 req-1439ab6c-af7a-467f-8b48-fed7ea42a42c service nova] Creating event network-vif-plugged:86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5 for instance bf1273ed-7fb4-4e81-90fe-576147c1be57 on user Apr 18 20:12:11 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-aa532bc6-e239-4fb3-ac59-bbaa3fdb1ae8 req-1439ab6c-af7a-467f-8b48-fed7ea42a42c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028419 Apr 18 20:12:11 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 50/141] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:12 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-d0cc48ff-2697-4031-a88d-b5d6f1752d92 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.163258 Apr 18 20:12:12 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 47/142] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:12:12 2023] GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d5a0b778-2417-4fdb-8781-8bff78d1e677 req-cded9b17-0900-4c5b-b9df-9238e1bf9aca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d5a0b778-2417-4fdb-8781-8bff78d1e677 req-cded9b17-0900-4c5b-b9df-9238e1bf9aca service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d5a0b778-2417-4fdb-8781-8bff78d1e677 req-cded9b17-0900-4c5b-b9df-9238e1bf9aca service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d5a0b778-2417-4fdb-8781-8bff78d1e677 req-cded9b17-0900-4c5b-b9df-9238e1bf9aca service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d5a0b778-2417-4fdb-8781-8bff78d1e677 req-cded9b17-0900-4c5b-b9df-9238e1bf9aca service nova] Creating event network-changed:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:12:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d5a0b778-2417-4fdb-8781-8bff78d1e677 req-cded9b17-0900-4c5b-b9df-9238e1bf9aca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030841 Apr 18 20:12:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 46/143] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:14 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:12:14 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-ff37eace-0a1e-4d2b-bdee-90ef2886f5e5 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 204 len: 0 microversion: 2.1 time: 0.106762 Apr 18 20:12:14 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 51/144] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:12:14 2023] DELETE /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:15 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50df8fc3c7b45aab932122e3131d101', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f789b31b9540e99ec1a3eb3fe2f384', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:15 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-e4ace591-2988-4999-a69f-75d8ade2a382 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 200 len: 1674 microversion: 2.1 time: 0.199744 Apr 18 20:12:15 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 48/145] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:14 2023] GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "name": "network-vif-unplugged", "status": "completed", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}, {"server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "name": "network-vif-plugged", "status": "completed", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:15 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] Creating event network-vif-unplugged:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:12:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] Creating event network-vif-plugged:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:12:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-ee736772-f273-41b2-8fb2-d6fde122da81 req-68a3e080-b296-433a-91f8-254edae8f3ca service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032358 Apr 18 20:12:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 47/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:15 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:17 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-d52f7499-0cc0-47f6-8e82-de805e74d261 req-5a30be59-181c-488f-afa3-e2dc4e71cfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d37952-598b-475e-ae48-5e985e477be4", "name": "network-vif-deleted", "tag": "d0589dd3-f948-49d6-bfcf-07dd5ba95c5b"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-d52f7499-0cc0-47f6-8e82-de805e74d261 req-5a30be59-181c-488f-afa3-e2dc4e71cfc7 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-d52f7499-0cc0-47f6-8e82-de805e74d261 req-5a30be59-181c-488f-afa3-e2dc4e71cfc7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-d52f7499-0cc0-47f6-8e82-de805e74d261 req-5a30be59-181c-488f-afa3-e2dc4e71cfc7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:17 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-d52f7499-0cc0-47f6-8e82-de805e74d261 req-5a30be59-181c-488f-afa3-e2dc4e71cfc7 service nova] Creating event network-vif-deleted:d0589dd3-f948-49d6-bfcf-07dd5ba95c5b for instance 19d37952-598b-475e-ae48-5e985e477be4 on user Apr 18 20:12:17 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-d52f7499-0cc0-47f6-8e82-de805e74d261 req-5a30be59-181c-488f-afa3-e2dc4e71cfc7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033807 Apr 18 20:12:17 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 52/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:21 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:21 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-9ac97c86-4097-4c7c-a08a-497118918e2e tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 200 len: 1537 microversion: 2.1 time: 0.242898 Apr 18 20:12:21 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 49/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:21 2023] GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 1537 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Searching by: {'deleted': False, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4'} {{(pid=61422) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:21 user devstack@n-api.service[61422]: DEBUG nova.compute.multi_cell_list [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61422) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 20:12:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-27af5cb5-394e-4db0-9a1b-d4e916254803 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.182011 Apr 18 20:12:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 48/149] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 20:12:21 2023] GET /compute/v2.1/servers => generated 340 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:22 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:22 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-181b5831-1e99-4f33-bafc-ab57b8cc236b tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 200 len: 1537 microversion: 2.1 time: 0.153554 Apr 18 20:12:22 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 53/150] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:21 2023] GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 1537 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:23 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:12:23 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-1e86af42-e279-49e8-a210-5c67b9980212 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 204 len: 0 microversion: 2.1 time: 0.117635 Apr 18 20:12:23 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 50/151] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:12:23 2023] DELETE /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:23 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0ebfd1b0-2b61-4a06-a857-c141d84beb45 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 200 len: 1543 microversion: 2.1 time: 0.223406 Apr 18 20:12:23 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 49/152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:23 2023] GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 1543 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 20:12:24 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-a34a9719-ed2f-4070-a5be-c90d719c20c7 req-d3eb71fe-c2e6-43ca-80c0-27e351370d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b2c8a-5d24-400c-b01e-cb285312e887", "name": "network-vif-unplugged", "status": "completed", "tag": "7cfe4735-5ac2-432f-aab8-3dd6330d3de2"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:24 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-a34a9719-ed2f-4070-a5be-c90d719c20c7 req-d3eb71fe-c2e6-43ca-80c0-27e351370d10 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:24 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-a34a9719-ed2f-4070-a5be-c90d719c20c7 req-d3eb71fe-c2e6-43ca-80c0-27e351370d10 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:24 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-a34a9719-ed2f-4070-a5be-c90d719c20c7 req-d3eb71fe-c2e6-43ca-80c0-27e351370d10 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:24 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-a34a9719-ed2f-4070-a5be-c90d719c20c7 req-d3eb71fe-c2e6-43ca-80c0-27e351370d10 service nova] Creating event network-vif-unplugged:7cfe4735-5ac2-432f-aab8-3dd6330d3de2 for instance c48b2c8a-5d24-400c-b01e-cb285312e887 on user Apr 18 20:12:24 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-a34a9719-ed2f-4070-a5be-c90d719c20c7 req-d3eb71fe-c2e6-43ca-80c0-27e351370d10 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030769 Apr 18 20:12:24 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 54/153] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:25 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-2ec53ef4-6c74-4f79-b123-410eb39e3c3c req-f1b3d071-bb9a-49fe-b6a7-19751e48bfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b2c8a-5d24-400c-b01e-cb285312e887", "name": "network-vif-deleted", "tag": "7cfe4735-5ac2-432f-aab8-3dd6330d3de2"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2ec53ef4-6c74-4f79-b123-410eb39e3c3c req-f1b3d071-bb9a-49fe-b6a7-19751e48bfa1 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2ec53ef4-6c74-4f79-b123-410eb39e3c3c req-f1b3d071-bb9a-49fe-b6a7-19751e48bfa1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2ec53ef4-6c74-4f79-b123-410eb39e3c3c req-f1b3d071-bb9a-49fe-b6a7-19751e48bfa1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-2ec53ef4-6c74-4f79-b123-410eb39e3c3c req-f1b3d071-bb9a-49fe-b6a7-19751e48bfa1 service nova] Creating event network-vif-deleted:7cfe4735-5ac2-432f-aab8-3dd6330d3de2 for instance c48b2c8a-5d24-400c-b01e-cb285312e887 on user Apr 18 20:12:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-2ec53ef4-6c74-4f79-b123-410eb39e3c3c req-f1b3d071-bb9a-49fe-b6a7-19751e48bfa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031453 Apr 18 20:12:25 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 51/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-10523f30-5a62-4663-a1d2-17ce86a502cb req-3b5fd2d7-2cd0-4ff8-8641-45e0b457dda8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c48b2c8a-5d24-400c-b01e-cb285312e887", "name": "network-vif-plugged", "status": "completed", "tag": "7cfe4735-5ac2-432f-aab8-3dd6330d3de2"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10523f30-5a62-4663-a1d2-17ce86a502cb req-3b5fd2d7-2cd0-4ff8-8641-45e0b457dda8 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10523f30-5a62-4663-a1d2-17ce86a502cb req-3b5fd2d7-2cd0-4ff8-8641-45e0b457dda8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-10523f30-5a62-4663-a1d2-17ce86a502cb req-3b5fd2d7-2cd0-4ff8-8641-45e0b457dda8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-10523f30-5a62-4663-a1d2-17ce86a502cb req-3b5fd2d7-2cd0-4ff8-8641-45e0b457dda8 service nova] Creating event network-vif-plugged:7cfe4735-5ac2-432f-aab8-3dd6330d3de2 for instance c48b2c8a-5d24-400c-b01e-cb285312e887 on user Apr 18 20:12:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-10523f30-5a62-4663-a1d2-17ce86a502cb req-3b5fd2d7-2cd0-4ff8-8641-45e0b457dda8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031710 Apr 18 20:12:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 50/155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-b47c90d8-75e1-4876-acd6-1fbab2b32f12 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.174495 Apr 18 20:12:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 55/156] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:12:28 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb/os-interface => generated 282 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] [instance: cd9040f3-b694-4af2-9486-854bf4d3b037] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] HTTP exception thrown: Instance cd9040f3-b694-4af2-9486-854bf4d3b037 could not be found. Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Request method failure captured: Apr 18 20:12:28 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037 HTTP/1.1 Apr 18 20:12:28 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:12:28 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:12:28 user devstack@n-api.service[61421]: Connection: close Apr 18 20:12:28 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:12:28 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:12:28 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:12:28 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:12:28 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkH9MW9A-VPN3zbQPohDnSy8Q6H-602C0FL8NZaPGSLeInTeFeR61RS84TzoiFRH8cO18FT4Y6xJ41my8y_sAddQVoNT2-Q0O21a11F6oPTKOL0MtgaZS0yV0CuPoKFFKoBJRcWXa80bksBbNM-98xi1U4jC_JqoFeKXeLwtK_um4g Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Project-Id: 496dfb775be64f09ad5d908edb15e484 Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Project-Name: tempest-DeleteServersTestJSON-1503386274 Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/496dfb775be64f09ad5d908edb15e484"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/496dfb775be64f09ad5d908edb15e484"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/496dfb775be64f09ad5d908edb15e484"}]}] Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Tenant: tempest-DeleteServersTestJSON-1503386274 Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Tenant-Id: 496dfb775be64f09ad5d908edb15e484 Apr 18 20:12:28 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-DeleteServersTestJSON-1503386274 Apr 18 20:12:28 user devstack@n-api.service[61421]: X-User: tempest-DeleteServersTestJSON-1503386274-project-member Apr 18 20:12:28 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:12:28 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:12:28 user devstack@n-api.service[61421]: X-User-Id: fda81ab9b2da4cd6b75e87c5085cfd1a Apr 18 20:12:28 user devstack@n-api.service[61421]: X-User-Name: tempest-DeleteServersTestJSON-1503386274-project-member Apr 18 20:12:28 user devstack@n-api.service[61421]: method: > Apr 18 20:12:28 user devstack@n-api.service[61421]: exception: Instance cd9040f3-b694-4af2-9486-854bf4d3b037 could not be found. Apr 18 20:12:28 user devstack@n-api.service[61421]: action_args: {'id': 'cd9040f3-b694-4af2-9486-854bf4d3b037'} Apr 18 20:12:28 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd9040f3-b694-4af2-9486-854bf4d3b037 could not be found. Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd9040f3-b694-4af2-9486-854bf4d3b037 could not be found. Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd9040f3-b694-4af2-9486-854bf4d3b037 could not be found. Apr 18 20:12:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:12:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] Returning 404 to user: Instance cd9040f3-b694-4af2-9486-854bf4d3b037 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:12:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-6c7cdca3-c18b-45f7-87e0-113c81149c2d tempest-DeleteServersTestJSON-1503386274 tempest-DeleteServersTestJSON-1503386274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037" status: 404 len: 111 microversion: 2.1 time: 0.031367 Apr 18 20:12:28 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 52/157] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:28 2023] GET /compute/v2.1/servers/cd9040f3-b694-4af2-9486-854bf4d3b037 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:12:29 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-faac3ec0-3af3-4fba-a9b1-c3a87288a5e3 req-85ce033c-444d-4faf-b613-ed3a3d5ebbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-faac3ec0-3af3-4fba-a9b1-c3a87288a5e3 req-85ce033c-444d-4faf-b613-ed3a3d5ebbd8 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-faac3ec0-3af3-4fba-a9b1-c3a87288a5e3 req-85ce033c-444d-4faf-b613-ed3a3d5ebbd8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:29 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-faac3ec0-3af3-4fba-a9b1-c3a87288a5e3 req-85ce033c-444d-4faf-b613-ed3a3d5ebbd8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-faac3ec0-3af3-4fba-a9b1-c3a87288a5e3 req-85ce033c-444d-4faf-b613-ed3a3d5ebbd8 service nova] Creating event network-changed:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:12:29 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-faac3ec0-3af3-4fba-a9b1-c3a87288a5e3 req-85ce033c-444d-4faf-b613-ed3a3d5ebbd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030556 Apr 18 20:12:29 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 51/158] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:29 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:29 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4eadc841-6e65-458b-9824-24d4b60cc437 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1538 microversion: 2.1 time: 0.249654 Apr 18 20:12:29 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 56/159] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:29 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1538 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:30 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-1ecb8f0b-9a71-47a6-9efc-4dbaaa6c2546 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1538 microversion: 2.1 time: 0.312141 Apr 18 20:12:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 53/160] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:29 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1538 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:31 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-5b1da3b0-33de-4a78-8952-23a3d3e2891d tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '.version_select at 0x7fb773b8dc60>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-5b1da3b0-33de-4a78-8952-23a3d3e2891d tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847" status: 200 len: 1725 microversion: 2.1 time: 0.050897 Apr 18 20:12:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 52/161] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 20:12:31 2023] GET /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847 => generated 1725 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:31 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-18eedd50-086e-4ddf-b63a-7692d8b6ac70 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '.version_select at 0x7fb773a0aa70>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:31 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-18eedd50-086e-4ddf-b63a-7692d8b6ac70 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847" status: 200 len: 1725 microversion: 2.1 time: 0.056197 Apr 18 20:12:31 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 57/162] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 20:12:31 2023] GET /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847 => generated 1725 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:32 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f19bcf69a6c4abca9f0744965a79d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1c758096d340d5bc72df80fae46f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-7bf88f0a-e77d-4350-b794-4ebfce9dfc8b tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 200 len: 1668 microversion: 2.1 time: 0.262340 Apr 18 20:12:32 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 54/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:31 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 1668 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] HTTP exception thrown: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Request method failure captured: Apr 18 20:12:33 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 HTTP/1.1 Apr 18 20:12:33 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:12:33 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:12:33 user devstack@n-api.service[61422]: Connection: close Apr 18 20:12:33 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:12:33 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:12:33 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:12:33 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:12:33 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkGWUUQzfSno_YOVGDqk58WBdkwEuDgkfz5muo8XailtvReSl6pBx-RI0U6U1M63Dmjoa_U70cU4sweSvS6yT1L8HBzzq92myKnXl6mQgmMK3z2hiJRv9wUzvd4_KEUDstq3dunXDWN-jr7jYJUOjXu6AWbSB7BoxeIhp0MssHwo88 Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Project-Id: a4584427b930494cbce6719967c325da Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a4584427b930494cbce6719967c325da"}]}] Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Tenant-Id: a4584427b930494cbce6719967c325da Apr 18 20:12:33 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:12:33 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:12:33 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:12:33 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:12:33 user devstack@n-api.service[61422]: X-User-Id: 2621a49d58c34c948ee000a94751a585 Apr 18 20:12:33 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:12:33 user devstack@n-api.service[61422]: method: > Apr 18 20:12:33 user devstack@n-api.service[61422]: exception: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:12:33 user devstack@n-api.service[61422]: action_args: {'id': '8764c1af-455f-4d21-9bd4-604ff561f656'} Apr 18 20:12:33 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:12:33 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:12:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Returning 404 to user: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:12:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-89a66560-3709-411b-938d-447bf67373ce tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 404 len: 111 microversion: 2.1 time: 0.037297 Apr 18 20:12:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 53/164] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:33 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:12:33 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-bad217e2-a130-4874-9ef7-180b00a864e3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '.version_select at 0x7fb773a0a8c0>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:33 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:33 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-bad217e2-a130-4874-9ef7-180b00a864e3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695000765" status: 202 len: 0 microversion: 2.1 time: 0.025295 Apr 18 20:12:33 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 58/165] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 20:12:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695000765 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:12:34 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-352a6c06-fd77-4e95-a87f-4d5f976dcb31 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Action: 'create', calling method: .version_select at 0x7fb773ab3a30>, body: {"keypair": {"name": "tempest-keypair-2141630914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvMV7dBG8PsDrB7mUSixcK7Nbfwiv7HzpvF4ua0Xp13/o6zOtGP8AGZPgVELOMZqJ9GDYGgcxevTK6OwEUSevY3euf/aebd4lMGw5WFScn8tK5U/UDBjAiARcnfjqDPqA=="}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:34 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:34 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-352a6c06-fd77-4e95-a87f-4d5f976dcb31 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for project a4584427b930494cbce6719967c325da. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:12:34 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-352a6c06-fd77-4e95-a87f-4d5f976dcb31 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for user 2621a49d58c34c948ee000a94751a585 and project a4584427b930494cbce6719967c325da. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:12:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-352a6c06-fd77-4e95-a87f-4d5f976dcb31 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.068943 Apr 18 20:12:34 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 55/166] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:12:34 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:35 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-698242489", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "1a455dc1-6931-43c6-b404-a42a7505cffe"}], "security_groups": [{"name": "tempest-securitygroup--1904907110"}], "key_name": "tempest-keypair-2141630914", "user_data": "}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:35 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:35 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] validate_networks() for [('1a455dc1-6931-43c6-b404-a42a7505cffe', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:35 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:35 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] HTTP exception thrown: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:12:36 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Request method failure captured: Apr 18 20:12:36 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 HTTP/1.1 Apr 18 20:12:36 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:12:36 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:12:36 user devstack@n-api.service[61420]: Connection: close Apr 18 20:12:36 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:12:36 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:12:36 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:12:36 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:12:36 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvkHAX878cEj9r5MplKxjiMUJHtoQvZmpQ7BniVySWiLb6QMi62v1ypUdfWbgvKO0OIjna3DgwN8JbS901D1_8dkZMaO5WKyw622KoYNsYCPa1AVEKhgvL8RLljhFL3CmjqGuMIpleDTC6Uatzr5SKccbDW6joLfSruQAKIwUWkidzg Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Project-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88511bc82db742b09c562ca4b6fac0ef"}]}] Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Tenant-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:12:36 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:12:36 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:12:36 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:12:36 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:12:36 user devstack@n-api.service[61420]: X-User-Id: 14e8456e134e454a82496708ce268345 Apr 18 20:12:36 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:12:36 user devstack@n-api.service[61420]: method: > Apr 18 20:12:36 user devstack@n-api.service[61420]: exception: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:12:36 user devstack@n-api.service[61420]: action_args: {'id': 'cca4f2c5-3084-4356-b066-56c998d051d0'} Apr 18 20:12:36 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:12:36 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:12:36 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Returning 404 to user: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:12:36 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-71d6eea3-b7ed-4216-950a-bab4b98afd02 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 404 len: 111 microversion: 2.20 time: 0.041892 Apr 18 20:12:36 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 59/167] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:12:35 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:12:36 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-89779072-e96b-4f4a-88cc-cbd2023f99a1 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '.version_select at 0x7fb773ab2050>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:36 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-89779072-e96b-4f4a-88cc-cbd2023f99a1 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-228834592" status: 204 len: 0 microversion: 2.20 time: 0.031572 Apr 18 20:12:36 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 56/168] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 20:12:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-228834592 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=29 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:36 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-6efe6867-b19f-46ca-86b9-b3c057f9ac3d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Action: 'create', calling method: .version_select at 0x7fb7739997e0>, body: {"keypair": {"name": "tempest-keypair-411596916", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfYslSIZ6jxX9wbCjjVALkcE4motO+XND9xPRU7GKz/SkZKFKjbmnX9VhxtWtZXB+zZdJ+94CPGWNXcFPD34HeNZ/VfWzyawdGf6ZMEPWSG76+oKF0UNmJXvueaBs19EA=="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for project a4584427b930494cbce6719967c325da. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Getting quotas for user 2621a49d58c34c948ee000a94751a585 and project a4584427b930494cbce6719967c325da. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:12:36 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-6efe6867-b19f-46ca-86b9-b3c057f9ac3d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:12:36 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:12:36 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-6efe6867-b19f-46ca-86b9-b3c057f9ac3d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for user 14e8456e134e454a82496708ce268345 and project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:12:36 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-6efe6867-b19f-46ca-86b9-b3c057f9ac3d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047123 Apr 18 20:12:36 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 60/169] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 20:12:36 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 20:12:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-dfaaa2e6-fdcc-4791-bd02-1bc901fbe13e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.985326 Apr 18 20:12:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 54/170] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:12:35 2023] POST /compute/v2.1/servers => generated 400 bytes in 987 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 18 20:12:36 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-8a8d280e-d72a-4b8a-bf0c-600ef4dfaee5 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:36 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-8a8d280e-d72a-4b8a-bf0c-600ef4dfaee5 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:36 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-8a8d280e-d72a-4b8a-bf0c-600ef4dfaee5 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621a49d58c34c948ee000a94751a585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4584427b930494cbce6719967c325da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:36 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-8a8d280e-d72a-4b8a-bf0c-600ef4dfaee5 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 200 len: 1231 microversion: 2.1 time: 0.068470 Apr 18 20:12:36 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 57/171] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:36 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 1231 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:12:38 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1381911620", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "d859f7bf-51df-4961-aaf1-e1fc33d6fce1"}], "security_groups": [{"name": "tempest-securitygroup--959531307"}], "key_name": "tempest-keypair-411596916", "user_data": "}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:38 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] validate_networks() for [('d859f7bf-51df-4961-aaf1-e1fc33d6fce1', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Getting quotas for user 14e8456e134e454a82496708ce268345 and project 88511bc82db742b09c562ca4b6fac0ef. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:12:39 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:12:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-656b437f-171b-4f4f-abb2-22632baf2090 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.394616 Apr 18 20:12:39 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 61/172] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:12:38 2023] POST /compute/v2.1/servers => generated 399 bytes in 1396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 20:12:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-113466b3-e02f-4a58-b79f-ae07ba2a5954 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:39 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-113466b3-e02f-4a58-b79f-ae07ba2a5954 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:40 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-113466b3-e02f-4a58-b79f-ae07ba2a5954 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:40 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-113466b3-e02f-4a58-b79f-ae07ba2a5954 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:40 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-113466b3-e02f-4a58-b79f-ae07ba2a5954 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:40 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-113466b3-e02f-4a58-b79f-ae07ba2a5954 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 200 len: 1275 microversion: 2.20 time: 0.453490 Apr 18 20:12:40 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 55/173] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:12:39 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 1275 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:12:40 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-748935163", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "5b16deaf-2b61-4095-91ec-8e78f9af18fe"}]}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:40 user devstack@n-api.service[61421]: DEBUG nova.network.neutron [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] validate_networks() for [('5b16deaf-2b61-4095-91ec-8e78f9af18fe', None, None, None, None, None)] {{(pid=61421) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:12:41 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-fad7e366-ce65-4e30-8e06-f75cec89f07f req-56dae3aa-a1ff-46bd-9b5b-582cd432d315 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fad7e366-ce65-4e30-8e06-f75cec89f07f req-56dae3aa-a1ff-46bd-9b5b-582cd432d315 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fad7e366-ce65-4e30-8e06-f75cec89f07f req-56dae3aa-a1ff-46bd-9b5b-582cd432d315 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fad7e366-ce65-4e30-8e06-f75cec89f07f req-56dae3aa-a1ff-46bd-9b5b-582cd432d315 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-fad7e366-ce65-4e30-8e06-f75cec89f07f req-56dae3aa-a1ff-46bd-9b5b-582cd432d315 service nova] Creating event network-changed:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:12:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-fad7e366-ce65-4e30-8e06-f75cec89f07f req-56dae3aa-a1ff-46bd-9b5b-582cd432d315 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034925 Apr 18 20:12:41 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 62/174] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for user 4918574af24b49d1b355bd3970ef6be4 and project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:12:41 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Going to run 1 instances... {{(pid=61421) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:12:42 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:12:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-23bdebf2-e069-4691-8a2f-d6c7eb095358 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.228392 Apr 18 20:12:42 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 58/175] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:12:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 20:12:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e0427c5b-5c8b-4c10-94b3-e41825577cad tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:42 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e0427c5b-5c8b-4c10-94b3-e41825577cad tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:42 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e0427c5b-5c8b-4c10-94b3-e41825577cad tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:42 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e0427c5b-5c8b-4c10-94b3-e41825577cad tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:42 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e0427c5b-5c8b-4c10-94b3-e41825577cad tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e0427c5b-5c8b-4c10-94b3-e41825577cad tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87" status: 200 len: 1394 microversion: 2.87 time: 0.077528 Apr 18 20:12:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 56/176] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:12:42 2023] GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87 => generated 1394 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:12:42 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-b3846a8b-a506-4427-8686-05683225b340 req-d91a6c25-767c-4c93-9dd4-2c0839a6ea70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b3846a8b-a506-4427-8686-05683225b340 req-d91a6c25-767c-4c93-9dd4-2c0839a6ea70 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b3846a8b-a506-4427-8686-05683225b340 req-d91a6c25-767c-4c93-9dd4-2c0839a6ea70 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b3846a8b-a506-4427-8686-05683225b340 req-d91a6c25-767c-4c93-9dd4-2c0839a6ea70 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:42 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-b3846a8b-a506-4427-8686-05683225b340 req-d91a6c25-767c-4c93-9dd4-2c0839a6ea70 service nova] Creating event network-changed:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:12:42 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-b3846a8b-a506-4427-8686-05683225b340 req-d91a6c25-767c-4c93-9dd4-2c0839a6ea70 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034139 Apr 18 20:12:42 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 63/177] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:12:46 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-2c557a4b-6c23-49a3-ade3-e5823b431faa req-35e6ea97-a654-4793-8183-6e60e39ee9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "name": "network-vif-plugged", "status": "completed", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:46 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2c557a4b-6c23-49a3-ade3-e5823b431faa req-35e6ea97-a654-4793-8183-6e60e39ee9b8 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:46 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2c557a4b-6c23-49a3-ade3-e5823b431faa req-35e6ea97-a654-4793-8183-6e60e39ee9b8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:46 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2c557a4b-6c23-49a3-ade3-e5823b431faa req-35e6ea97-a654-4793-8183-6e60e39ee9b8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:46 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-2c557a4b-6c23-49a3-ade3-e5823b431faa req-35e6ea97-a654-4793-8183-6e60e39ee9b8 service nova] Creating event network-vif-plugged:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:12:46 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-2c557a4b-6c23-49a3-ade3-e5823b431faa req-35e6ea97-a654-4793-8183-6e60e39ee9b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032258 Apr 18 20:12:46 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 59/178] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-74614d05-379f-4d28-8624-b0fcb4c6dc23 req-adb6f737-a06e-4891-a574-cd70a2157d77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "name": "network-vif-plugged", "status": "completed", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-74614d05-379f-4d28-8624-b0fcb4c6dc23 req-adb6f737-a06e-4891-a574-cd70a2157d77 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-74614d05-379f-4d28-8624-b0fcb4c6dc23 req-adb6f737-a06e-4891-a574-cd70a2157d77 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-74614d05-379f-4d28-8624-b0fcb4c6dc23 req-adb6f737-a06e-4891-a574-cd70a2157d77 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-74614d05-379f-4d28-8624-b0fcb4c6dc23 req-adb6f737-a06e-4891-a574-cd70a2157d77 service nova] Creating event network-vif-plugged:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:12:46 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-74614d05-379f-4d28-8624-b0fcb4c6dc23 req-adb6f737-a06e-4891-a574-cd70a2157d77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039979 Apr 18 20:12:46 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 57/179] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-5219e8a5-2482-486f-b6ea-21b2f7e98ec8 req-5132035a-50f9-428e-863c-6a540cce8776 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "name": "network-vif-plugged", "status": "completed", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-5219e8a5-2482-486f-b6ea-21b2f7e98ec8 req-5132035a-50f9-428e-863c-6a540cce8776 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-5219e8a5-2482-486f-b6ea-21b2f7e98ec8 req-5132035a-50f9-428e-863c-6a540cce8776 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-5219e8a5-2482-486f-b6ea-21b2f7e98ec8 req-5132035a-50f9-428e-863c-6a540cce8776 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-5219e8a5-2482-486f-b6ea-21b2f7e98ec8 req-5132035a-50f9-428e-863c-6a540cce8776 service nova] Creating event network-vif-plugged:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:12:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-5219e8a5-2482-486f-b6ea-21b2f7e98ec8 req-5132035a-50f9-428e-863c-6a540cce8776 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037309 Apr 18 20:12:48 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 64/180] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:48 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-f1ab60e3-99e2-4f1c-98cb-843e0d0b49be req-d25eee93-7920-4c17-92c1-25004a1b4106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "name": "network-vif-plugged", "status": "completed", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f1ab60e3-99e2-4f1c-98cb-843e0d0b49be req-d25eee93-7920-4c17-92c1-25004a1b4106 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f1ab60e3-99e2-4f1c-98cb-843e0d0b49be req-d25eee93-7920-4c17-92c1-25004a1b4106 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f1ab60e3-99e2-4f1c-98cb-843e0d0b49be req-d25eee93-7920-4c17-92c1-25004a1b4106 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:48 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-f1ab60e3-99e2-4f1c-98cb-843e0d0b49be req-d25eee93-7920-4c17-92c1-25004a1b4106 service nova] Creating event network-vif-plugged:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:12:48 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-f1ab60e3-99e2-4f1c-98cb-843e0d0b49be req-d25eee93-7920-4c17-92c1-25004a1b4106 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029802 Apr 18 20:12:48 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 60/181] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:49 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:49 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-c7469f8f-51cc-444f-a3e8-2d8a124b0fef req-5f131c19-d64a-4aaf-8784-f8adaa70204e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19e4dcba-70f9-439b-9f92-9891c34e7a87", "tag": "c1322312-f224-4dab-9848-339629b4233f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c7469f8f-51cc-444f-a3e8-2d8a124b0fef req-5f131c19-d64a-4aaf-8784-f8adaa70204e service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c7469f8f-51cc-444f-a3e8-2d8a124b0fef req-5f131c19-d64a-4aaf-8784-f8adaa70204e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:49 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c7469f8f-51cc-444f-a3e8-2d8a124b0fef req-5f131c19-d64a-4aaf-8784-f8adaa70204e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-c7469f8f-51cc-444f-a3e8-2d8a124b0fef req-5f131c19-d64a-4aaf-8784-f8adaa70204e service nova] Creating event network-changed:c1322312-f224-4dab-9848-339629b4233f for instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 on user Apr 18 20:12:49 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-c7469f8f-51cc-444f-a3e8-2d8a124b0fef req-5f131c19-d64a-4aaf-8784-f8adaa70204e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046360 Apr 18 20:12:49 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 58/182] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=10 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-3b58a363-852a-4efd-bbd9-11c38aab8559 req-74aecaff-dde6-44d4-8643-5c983e652a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19e4dcba-70f9-439b-9f92-9891c34e7a87", "name": "network-vif-deleted", "tag": "c1322312-f224-4dab-9848-339629b4233f"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3b58a363-852a-4efd-bbd9-11c38aab8559 req-74aecaff-dde6-44d4-8643-5c983e652a9e service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3b58a363-852a-4efd-bbd9-11c38aab8559 req-74aecaff-dde6-44d4-8643-5c983e652a9e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-3b58a363-852a-4efd-bbd9-11c38aab8559 req-74aecaff-dde6-44d4-8643-5c983e652a9e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:52 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.compute.server_external_events [req-3b58a363-852a-4efd-bbd9-11c38aab8559 req-74aecaff-dde6-44d4-8643-5c983e652a9e service nova] Unable to find a host for instance 19e4dcba-70f9-439b-9f92-9891c34e7a87. Dropping event network-vif-deleted {{(pid=61420) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 20:12:52 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-3b58a363-852a-4efd-bbd9-11c38aab8559 req-74aecaff-dde6-44d4-8643-5c983e652a9e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.034910 Apr 18 20:12:52 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 65/183] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:12:52 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=12 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:12:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:12:56 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa0db0e3abe4c74b549c7051a97a3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5a7248acf744b1b289c36e0d684b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:12:56 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-256c6531-be1b-4fc2-b563-663bfd9294f9 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57" status: 200 len: 1495 microversion: 2.1 time: 0.414033 Apr 18 20:12:56 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 61/184] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:12:55 2023] GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57 => generated 1495 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=10 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-749688212", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] validate_networks() for [('3577a40f-a2be-431f-aed8-e8fdfff88a5a', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Getting quotas for project b60e04e321f04d968e519604c9836836. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Getting quotas for user 8f8fb8390e03457580eda1c8e325cbb5 and project b60e04e321f04d968e519604c9836836. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:13:04 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:13:04 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-68686dd2-9083-444a-87d2-f18c62d2b302 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.657747 Apr 18 20:13:04 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 59/185] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:13:04 2023] POST /compute/v2.1/servers => generated 381 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:13:04 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4c7665f5-6c70-4bff-a1fa-e2328ee41fad tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:04 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-4c7665f5-6c70-4bff-a1fa-e2328ee41fad tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:04 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:04 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=11 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:05 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-4c7665f5-6c70-4bff-a1fa-e2328ee41fad tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:05 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4c7665f5-6c70-4bff-a1fa-e2328ee41fad tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea" status: 200 len: 1215 microversion: 2.1 time: 0.079086 Apr 18 20:13:05 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 66/186] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:04 2023] GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-273402656", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] HTTP exception thrown: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Request method failure captured: Apr 18 20:13:05 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 HTTP/1.1 Apr 18 20:13:05 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:13:05 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:13:05 user devstack@n-api.service[61422]: Connection: close Apr 18 20:13:05 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:13:05 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:13:05 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:13:05 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:13:05 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkIZmjcet54GWFZRePXyk-VxEid07KT3Zzq9UrBM8LuBKTBQhYwkIsZ9FAp75mQ8el3kqbxKpGSriUuGdESe9xCLoYdYoGRJQF3onWQsrDNQVh_3VuGx4q73IkStxzeneWOkPuaFdy0Zi_R8XwcmkTBf9v6xP8Y0tNaZ9VE8MJa9HA Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Project-Id: 31f789b31b9540e99ec1a3eb3fe2f384 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31f789b31b9540e99ec1a3eb3fe2f384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31f789b31b9540e99ec1a3eb3fe2f384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31f789b31b9540e99ec1a3eb3fe2f384"}]}] Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Tenant-Id: 31f789b31b9540e99ec1a3eb3fe2f384 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-User: tempest-AttachSCSIVolumeTestJSON-1048527492-project-member Apr 18 20:13:05 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:13:05 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:13:05 user devstack@n-api.service[61422]: X-User-Id: d50df8fc3c7b45aab932122e3131d101 Apr 18 20:13:05 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1048527492-project-member Apr 18 20:13:05 user devstack@n-api.service[61422]: method: > Apr 18 20:13:05 user devstack@n-api.service[61422]: exception: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:05 user devstack@n-api.service[61422]: action_args: {'id': '19d37952-598b-475e-ae48-5e985e477be4'} Apr 18 20:13:05 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:05 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Returning 404 to user: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:13:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-72f61cd1-0f0c-4f76-bf42-9b2f59f46de9 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 404 len: 111 microversion: 2.1 time: 0.027313 Apr 18 20:13:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 60/187] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:05 2023] GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.network.neutron [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] validate_networks() for [('3577a40f-a2be-431f-aed8-e8fdfff88a5a', None, None, None, None, None)] {{(pid=61421) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:13:05 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-c60b3249-fe6b-4615-be7e-9c036ce0c365 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '.version_select at 0x7fb77399bd90>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:05 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-c60b3249-fe6b-4615-be7e-9c036ce0c365 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244138421" status: 202 len: 0 microversion: 2.1 time: 0.026927 Apr 18 20:13:05 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 67/188] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 20:13:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1244138421 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Flavor limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Image limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Flavor pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Image pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Getting quotas for project b60e04e321f04d968e519604c9836836. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Getting quotas for user 8f8fb8390e03457580eda1c8e325cbb5 and project b60e04e321f04d968e519604c9836836. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Going to run 1 instances... {{(pid=61421) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:13:05 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:13:05 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-329c377a-81f1-488a-8008-6181f14ba044 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.503769 Apr 18 20:13:05 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 62/189] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:13:05 2023] POST /compute/v2.1/servers => generated 381 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-b3677c65-7257-4775-967b-ed3fc71a4e55 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-b3677c65-7257-4775-967b-ed3fc71a4e55 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:05 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-b3677c65-7257-4775-967b-ed3fc71a4e55 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:05 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-b3677c65-7257-4775-967b-ed3fc71a4e55 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 200 len: 1215 microversion: 2.1 time: 0.068108 Apr 18 20:13:05 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 61/190] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:05 2023] GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:06 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] HTTP exception thrown: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Request method failure captured: Apr 18 20:13:06 user devstack@n-api.service[61420]: request: DELETE /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 HTTP/1.1 Apr 18 20:13:06 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:13:06 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:13:06 user devstack@n-api.service[61420]: Connection: close Apr 18 20:13:06 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:13:06 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:13:06 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:13:06 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:13:06 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvkIZmjcet54GWFZRePXyk-VxEid07KT3Zzq9UrBM8LuBKTBQhYwkIsZ9FAp75mQ8el3kqbxKpGSriUuGdESe9xCLoYdYoGRJQF3onWQsrDNQVh_3VuGx4q73IkStxzeneWOkPuaFdy0Zi_R8XwcmkTBf9v6xP8Y0tNaZ9VE8MJa9HA Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Project-Id: 31f789b31b9540e99ec1a3eb3fe2f384 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31f789b31b9540e99ec1a3eb3fe2f384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31f789b31b9540e99ec1a3eb3fe2f384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31f789b31b9540e99ec1a3eb3fe2f384"}]}] Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Tenant-Id: 31f789b31b9540e99ec1a3eb3fe2f384 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-User: tempest-AttachSCSIVolumeTestJSON-1048527492-project-member Apr 18 20:13:06 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:13:06 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:13:06 user devstack@n-api.service[61420]: X-User-Id: d50df8fc3c7b45aab932122e3131d101 Apr 18 20:13:06 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1048527492-project-member Apr 18 20:13:06 user devstack@n-api.service[61420]: method: > Apr 18 20:13:06 user devstack@n-api.service[61420]: exception: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61420]: action_args: {'id': '19d37952-598b-475e-ae48-5e985e477be4'} Apr 18 20:13:06 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Returning 404 to user: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:13:06 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-a439f4d6-5d9a-419d-855f-791b30687812 tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 404 len: 111 microversion: 2.1 time: 0.029227 Apr 18 20:13:06 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 68/191] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:13:06 2023] DELETE /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] [instance: 19d37952-598b-475e-ae48-5e985e477be4] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:06 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] HTTP exception thrown: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Request method failure captured: Apr 18 20:13:06 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 HTTP/1.1 Apr 18 20:13:06 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:13:06 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:13:06 user devstack@n-api.service[61421]: Connection: close Apr 18 20:13:06 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:13:06 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:13:06 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:13:06 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:13:06 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkIZmjcet54GWFZRePXyk-VxEid07KT3Zzq9UrBM8LuBKTBQhYwkIsZ9FAp75mQ8el3kqbxKpGSriUuGdESe9xCLoYdYoGRJQF3onWQsrDNQVh_3VuGx4q73IkStxzeneWOkPuaFdy0Zi_R8XwcmkTBf9v6xP8Y0tNaZ9VE8MJa9HA Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Project-Id: 31f789b31b9540e99ec1a3eb3fe2f384 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31f789b31b9540e99ec1a3eb3fe2f384"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/31f789b31b9540e99ec1a3eb3fe2f384"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/31f789b31b9540e99ec1a3eb3fe2f384"}]}] Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Tenant-Id: 31f789b31b9540e99ec1a3eb3fe2f384 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1048527492 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-User: tempest-AttachSCSIVolumeTestJSON-1048527492-project-member Apr 18 20:13:06 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:13:06 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:13:06 user devstack@n-api.service[61421]: X-User-Id: d50df8fc3c7b45aab932122e3131d101 Apr 18 20:13:06 user devstack@n-api.service[61421]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1048527492-project-member Apr 18 20:13:06 user devstack@n-api.service[61421]: method: > Apr 18 20:13:06 user devstack@n-api.service[61421]: exception: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61421]: action_args: {'id': '19d37952-598b-475e-ae48-5e985e477be4'} Apr 18 20:13:06 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. Apr 18 20:13:06 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:06 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] Returning 404 to user: Instance 19d37952-598b-475e-ae48-5e985e477be4 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:13:06 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-07b72b5b-2475-422b-b197-acd094c38c0d tempest-AttachSCSIVolumeTestJSON-1048527492 tempest-AttachSCSIVolumeTestJSON-1048527492-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4" status: 404 len: 111 microversion: 2.1 time: 0.032680 Apr 18 20:13:06 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 63/192] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:06 2023] GET /compute/v2.1/servers/19d37952-598b-475e-ae48-5e985e477be4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:13:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-5880da60-4114-4cd7-bf72-f73aea09216e req-735d23f1-ead4-484e-bd78-ff89845805a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67b7bded-501f-4ff6-9d5f-ae1a15ea8cea", "tag": "4d399ed7-5707-4e55-991c-e0ae1f1ead0f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5880da60-4114-4cd7-bf72-f73aea09216e req-735d23f1-ead4-484e-bd78-ff89845805a2 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5880da60-4114-4cd7-bf72-f73aea09216e req-735d23f1-ead4-484e-bd78-ff89845805a2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-5880da60-4114-4cd7-bf72-f73aea09216e req-735d23f1-ead4-484e-bd78-ff89845805a2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-5880da60-4114-4cd7-bf72-f73aea09216e req-735d23f1-ead4-484e-bd78-ff89845805a2 service nova] Creating event network-changed:4d399ed7-5707-4e55-991c-e0ae1f1ead0f for instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea on user Apr 18 20:13:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-5880da60-4114-4cd7-bf72-f73aea09216e req-735d23f1-ead4-484e-bd78-ff89845805a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027216 Apr 18 20:13:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 62/193] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:09 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-7fd1dc0d-1222-443d-80ec-0259c1c8e376 req-1de01019-18f4-4288-b935-2114bc09b21b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:09 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-7fd1dc0d-1222-443d-80ec-0259c1c8e376 req-1de01019-18f4-4288-b935-2114bc09b21b service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:09 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-7fd1dc0d-1222-443d-80ec-0259c1c8e376 req-1de01019-18f4-4288-b935-2114bc09b21b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:09 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-7fd1dc0d-1222-443d-80ec-0259c1c8e376 req-1de01019-18f4-4288-b935-2114bc09b21b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:09 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-7fd1dc0d-1222-443d-80ec-0259c1c8e376 req-1de01019-18f4-4288-b935-2114bc09b21b service nova] Creating event network-changed:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:13:09 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-7fd1dc0d-1222-443d-80ec-0259c1c8e376 req-1de01019-18f4-4288-b935-2114bc09b21b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029302 Apr 18 20:13:09 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 69/194] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:09 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:13:11 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b7bded-501f-4ff6-9d5f-ae1a15ea8cea", "name": "network-vif-plugged", "status": "completed", "tag": "4d399ed7-5707-4e55-991c-e0ae1f1ead0f"}, {"server_uuid": "67b7bded-501f-4ff6-9d5f-ae1a15ea8cea", "name": "network-vif-plugged", "status": "completed", "tag": "4d399ed7-5707-4e55-991c-e0ae1f1ead0f"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:11 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:11 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] Creating event network-vif-plugged:4d399ed7-5707-4e55-991c-e0ae1f1ead0f for instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea on user Apr 18 20:13:11 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] Creating event network-vif-plugged:4d399ed7-5707-4e55-991c-e0ae1f1ead0f for instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea on user Apr 18 20:13:11 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-a95b99e9-c506-4e11-bee8-c8afd9d24853 req-852577af-be6a-4f56-84fe-68fcd77126a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036814 Apr 18 20:13:11 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 64/195] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:11 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-701f655f-f4a8-44e0-88dd-a9884881caa1 req-a9c22028-0eba-4dd9-8f7a-f7ed09e4d556 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-701f655f-f4a8-44e0-88dd-a9884881caa1 req-a9c22028-0eba-4dd9-8f7a-f7ed09e4d556 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-701f655f-f4a8-44e0-88dd-a9884881caa1 req-a9c22028-0eba-4dd9-8f7a-f7ed09e4d556 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:11 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-701f655f-f4a8-44e0-88dd-a9884881caa1 req-a9c22028-0eba-4dd9-8f7a-f7ed09e4d556 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-701f655f-f4a8-44e0-88dd-a9884881caa1 req-a9c22028-0eba-4dd9-8f7a-f7ed09e4d556 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:13:11 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-701f655f-f4a8-44e0-88dd-a9884881caa1 req-a9c22028-0eba-4dd9-8f7a-f7ed09e4d556 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033392 Apr 18 20:13:11 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 63/196] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:13 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-de54c46f-a138-401b-848c-a3f29ff2bb91 req-5a09129c-a041-4069-b340-45513fe71fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-de54c46f-a138-401b-848c-a3f29ff2bb91 req-5a09129c-a041-4069-b340-45513fe71fa6 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-de54c46f-a138-401b-848c-a3f29ff2bb91 req-5a09129c-a041-4069-b340-45513fe71fa6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-de54c46f-a138-401b-848c-a3f29ff2bb91 req-5a09129c-a041-4069-b340-45513fe71fa6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:13 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-de54c46f-a138-401b-848c-a3f29ff2bb91 req-5a09129c-a041-4069-b340-45513fe71fa6 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:13:13 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-de54c46f-a138-401b-848c-a3f29ff2bb91 req-5a09129c-a041-4069-b340-45513fe71fa6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032166 Apr 18 20:13:13 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 70/197] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: c48b2c8a-5d24-400c-b01e-cb285312e887] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=18 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:14 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] HTTP exception thrown: Instance c48b2c8a-5d24-400c-b01e-cb285312e887 could not be found. Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Request method failure captured: Apr 18 20:13:14 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 HTTP/1.1 Apr 18 20:13:14 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:13:14 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:13:14 user devstack@n-api.service[61421]: Connection: close Apr 18 20:13:14 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:13:14 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:13:14 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:13:14 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:13:14 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkor7w5S_kJ5S7QiOfu3DehUQSthnJXG87FFnnTwC7JbJYzYDt3WJ6xeTB9Hxck3iRp4edamk5PYFvgX4nUOR-sd7icOUp0EdC-yn1kZ0V3XgZognz2zBSO75T6pAI5LV_M1SUM_r1Iir9QcR2tKZt5POTbrF2DviN9f1UFYMvhR20 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Project-Id: 6ad73ba40edd4087aff9ae96a69e10c4 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Project-Name: tempest-TestMinimumBasicScenario-1534810194 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ad73ba40edd4087aff9ae96a69e10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ad73ba40edd4087aff9ae96a69e10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ad73ba40edd4087aff9ae96a69e10c4"}]}] Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Tenant: tempest-TestMinimumBasicScenario-1534810194 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Tenant-Id: 6ad73ba40edd4087aff9ae96a69e10c4 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1534810194 Apr 18 20:13:14 user devstack@n-api.service[61421]: X-User: tempest-TestMinimumBasicScenario-1534810194-project-member Apr 18 20:13:14 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:13:14 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:13:14 user devstack@n-api.service[61421]: X-User-Id: 48ac512f13754a49bde814ba9e7103ed Apr 18 20:13:14 user devstack@n-api.service[61421]: X-User-Name: tempest-TestMinimumBasicScenario-1534810194-project-member Apr 18 20:13:14 user devstack@n-api.service[61421]: method: > Apr 18 20:13:14 user devstack@n-api.service[61421]: exception: Instance c48b2c8a-5d24-400c-b01e-cb285312e887 could not be found. Apr 18 20:13:14 user devstack@n-api.service[61421]: action_args: {'id': 'c48b2c8a-5d24-400c-b01e-cb285312e887'} Apr 18 20:13:14 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c48b2c8a-5d24-400c-b01e-cb285312e887 could not be found. Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c48b2c8a-5d24-400c-b01e-cb285312e887 could not be found. Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c48b2c8a-5d24-400c-b01e-cb285312e887 could not be found. Apr 18 20:13:14 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:14 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Returning 404 to user: Instance c48b2c8a-5d24-400c-b01e-cb285312e887 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:13:14 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-7de32736-58cb-4dd4-b084-3bc566997395 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887" status: 404 len: 111 microversion: 2.1 time: 0.065954 Apr 18 20:13:14 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 65/198] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:14 2023] GET /compute/v2.1/servers/c48b2c8a-5d24-400c-b01e-cb285312e887 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:13:14 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-f45f2be4-454c-4ac9-8676-03632397ff99 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '.version_select at 0x7fb77507d870>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-f45f2be4-454c-4ac9-8676-03632397ff99 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2141294217" status: 202 len: 0 microversion: 2.1 time: 0.022197 Apr 18 20:13:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 64/199] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 20:13:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2141294217 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:13:16 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:16 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-68709dc4-7ea8-4a62-a2d4-d9fdd0aa2cb6 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Action: 'create', calling method: .version_select at 0x7fb77399a050>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1260195738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPx0/Ctye8bwTqUiS06eOHPC25Bk24ze5uuSDafktqMkSKOnlFcvNg5YT494NeuAO2qsge0WDWkFD6tqLckrqj6GmPVtraUxBLh8ngovMKR7GS+tQf0ZatftbUPyXVO8OQ=="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:16 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-68709dc4-7ea8-4a62-a2d4-d9fdd0aa2cb6 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:16 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-68709dc4-7ea8-4a62-a2d4-d9fdd0aa2cb6 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for user 48ac512f13754a49bde814ba9e7103ed and project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:16 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-68709dc4-7ea8-4a62-a2d4-d9fdd0aa2cb6 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056986 Apr 18 20:13:16 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 71/200] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:13:16 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:16 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1538374999", "imageRef": "a2e8bee7-4829-4254-bb21-b28cefae5e8e", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1260195738", "networks": [{"uuid": "4701fbad-415a-40b8-afc1-2a18650aa308"}]}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:16 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:16 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:16 user devstack@n-api.service[61421]: DEBUG nova.network.neutron [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] validate_networks() for [('4701fbad-415a-40b8-afc1-2a18650aa308', None, None, None, None, None)] {{(pid=61421) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Flavor limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Image limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Flavor pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Image pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Getting quotas for user 48ac512f13754a49bde814ba9e7103ed and project 6ad73ba40edd4087aff9ae96a69e10c4. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Going to run 1 instances... {{(pid=61421) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:13:17 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a2e8bee7-4829-4254-bb21-b28cefae5e8e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:13:17 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-709daf72-53b8-4b5e-83ba-687b19e20a6f tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.641573 Apr 18 20:13:17 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 66/201] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:13:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:13:17 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7756c9eb-2f9b-4f9a-8235-e21a7f624487 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:17 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7756c9eb-2f9b-4f9a-8235-e21a7f624487 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:17 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:17 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:17 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-7756c9eb-2f9b-4f9a-8235-e21a7f624487 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:17 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7756c9eb-2f9b-4f9a-8235-e21a7f624487 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 200 len: 1253 microversion: 2.1 time: 0.071526 Apr 18 20:13:17 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 65/202] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:17 2023] GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 1253 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:20 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:20 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-156e4403-f8ce-420c-ac4b-b3f4e0cd0050 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.236720 Apr 18 20:13:20 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 72/203] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:20 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:20 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:20 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-4876731c-7c86-4e89-ba65-8e6cf97254bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.148734 Apr 18 20:13:20 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 67/204] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:20 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-bbc6d1e0-8ce2-41ed-8913-51beebdf1856 req-e24a7338-8339-4561-b735-1478b3fea817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cd23717-f912-486a-8a0f-983edcbf5ba2", "tag": "56b439b1-1255-4f49-ae1b-26bee78f2efe"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bbc6d1e0-8ce2-41ed-8913-51beebdf1856 req-e24a7338-8339-4561-b735-1478b3fea817 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bbc6d1e0-8ce2-41ed-8913-51beebdf1856 req-e24a7338-8339-4561-b735-1478b3fea817 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bbc6d1e0-8ce2-41ed-8913-51beebdf1856 req-e24a7338-8339-4561-b735-1478b3fea817 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-bbc6d1e0-8ce2-41ed-8913-51beebdf1856 req-e24a7338-8339-4561-b735-1478b3fea817 service nova] Creating event network-changed:56b439b1-1255-4f49-ae1b-26bee78f2efe for instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 on user Apr 18 20:13:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-bbc6d1e0-8ce2-41ed-8913-51beebdf1856 req-e24a7338-8339-4561-b735-1478b3fea817 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030366 Apr 18 20:13:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 66/205] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:24 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-cd6ed353-c26e-4c29-8ddb-bba4dda365cc req-edf1d5e0-cb86-4b7b-8657-f4320a8b57c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd23717-f912-486a-8a0f-983edcbf5ba2", "name": "network-vif-plugged", "status": "completed", "tag": "56b439b1-1255-4f49-ae1b-26bee78f2efe"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:24 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-cd6ed353-c26e-4c29-8ddb-bba4dda365cc req-edf1d5e0-cb86-4b7b-8657-f4320a8b57c2 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:24 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-cd6ed353-c26e-4c29-8ddb-bba4dda365cc req-edf1d5e0-cb86-4b7b-8657-f4320a8b57c2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:24 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-cd6ed353-c26e-4c29-8ddb-bba4dda365cc req-edf1d5e0-cb86-4b7b-8657-f4320a8b57c2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:24 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-cd6ed353-c26e-4c29-8ddb-bba4dda365cc req-edf1d5e0-cb86-4b7b-8657-f4320a8b57c2 service nova] Creating event network-vif-plugged:56b439b1-1255-4f49-ae1b-26bee78f2efe for instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 on user Apr 18 20:13:24 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-cd6ed353-c26e-4c29-8ddb-bba4dda365cc req-edf1d5e0-cb86-4b7b-8657-f4320a8b57c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053027 Apr 18 20:13:24 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 73/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:26 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-763f823c-9807-4ea1-bc8b-60fae75d7bff req-7a688b32-61ce-4c9b-ab30-3b4f9ae4eba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd23717-f912-486a-8a0f-983edcbf5ba2", "name": "network-vif-plugged", "status": "completed", "tag": "56b439b1-1255-4f49-ae1b-26bee78f2efe"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-763f823c-9807-4ea1-bc8b-60fae75d7bff req-7a688b32-61ce-4c9b-ab30-3b4f9ae4eba0 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-763f823c-9807-4ea1-bc8b-60fae75d7bff req-7a688b32-61ce-4c9b-ab30-3b4f9ae4eba0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-763f823c-9807-4ea1-bc8b-60fae75d7bff req-7a688b32-61ce-4c9b-ab30-3b4f9ae4eba0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:26 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-763f823c-9807-4ea1-bc8b-60fae75d7bff req-7a688b32-61ce-4c9b-ab30-3b4f9ae4eba0 service nova] Creating event network-vif-plugged:56b439b1-1255-4f49-ae1b-26bee78f2efe for instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 on user Apr 18 20:13:26 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-763f823c-9807-4ea1-bc8b-60fae75d7bff req-7a688b32-61ce-4c9b-ab30-3b4f9ae4eba0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035523 Apr 18 20:13:26 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 68/207] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:27 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621a49d58c34c948ee000a94751a585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4584427b930494cbce6719967c325da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:27 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-11369418-c8a1-4be8-8262-e7f799be7fe2 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 200 len: 1537 microversion: 2.1 time: 0.495073 Apr 18 20:13:27 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 67/208] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:26 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 1537 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:30 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:31 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:31 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:31 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-b768fcc3-d817-46f1-b4ef-2e8028d7d6d7 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 200 len: 1586 microversion: 2.20 time: 0.565472 Apr 18 20:13:31 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 74/209] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:13:30 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 1586 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG nova.objects.instance [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lazy-loading 'fault' on Instance uuid 19e4dcba-70f9-439b-9f92-9891c34e7a87 {{(pid=61421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:32 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-0014b0b0-876d-4e76-808a-2322fd4aa0a6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87" status: 200 len: 1649 microversion: 2.87 time: 0.180568 Apr 18 20:13:32 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 69/210] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:13:32 2023] GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87 => generated 1649 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Doing local delete in cell 285bd6ea-7144-4ccd-a44d-fb1de459fade(cell1) {{(pid=61422) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61422]: WARNING nova.compute.api [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] instance's host None is down, deleting from database Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] deallocate_for_instance() {{(pid=61422) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Instance cache missing network info. {{(pid=61422) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Updating instance_info_cache with network_info: [] {{(pid=61422) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 20:13:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61422) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:32 user devstack@n-api.service[61422]: WARNING nova.compute.api [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 20:13:32 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f19bcf69a6c4abca9f0744965a79d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1c758096d340d5bc72df80fae46f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-2c68fb77-4326-4bc6-99fa-7750ac0e1bb7 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 200 len: 1668 microversion: 2.1 time: 0.243548 Apr 18 20:13:32 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 75/211] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:32 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 1668 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-548200ba-7c9d-46cc-a4ec-5d8082df27af tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87" status: 204 len: 0 microversion: 2.87 time: 0.683269 Apr 18 20:13:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 68/212] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:13:32 2023] DELETE /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 19e4dcba-70f9-439b-9f92-9891c34e7a87] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:33 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] HTTP exception thrown: Instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 could not be found. Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Request method failure captured: Apr 18 20:13:33 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87 HTTP/1.1 Apr 18 20:13:33 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:13:33 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:13:33 user devstack@n-api.service[61421]: Connection: close Apr 18 20:13:33 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:13:33 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:13:33 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:13:33 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:13:33 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkEp9tBh9JgSefVTQbPbckzU2zbiAF2TonKcmCIymhDNgqAw9wQgxR2ZNGQsLA6vkEmyHynGzW543TY8xcpIxpgBf9r9AIjEWNtX2mgtTCR6kCYQ3nfv82A0ipYjLT3a-qyXZdEbRXRk6tYvRHAQCOql8E3SoH35JyupAtxKP1DcXM Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Project-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51729e3d9f3464789aa11df3369e717"}]}] Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Tenant-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:13:33 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:13:33 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:13:33 user devstack@n-api.service[61421]: X-User-Id: 4918574af24b49d1b355bd3970ef6be4 Apr 18 20:13:33 user devstack@n-api.service[61421]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:13:33 user devstack@n-api.service[61421]: method: > Apr 18 20:13:33 user devstack@n-api.service[61421]: exception: Instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 could not be found. Apr 18 20:13:33 user devstack@n-api.service[61421]: action_args: {'id': '19e4dcba-70f9-439b-9f92-9891c34e7a87'} Apr 18 20:13:33 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 could not be found. Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 could not be found. Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 could not be found. Apr 18 20:13:33 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:13:33 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Returning 404 to user: Instance 19e4dcba-70f9-439b-9f92-9891c34e7a87 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:13:33 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-70b4a490-25f4-4620-bd88-4b77c6bab9ea tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87" status: 404 len: 111 microversion: 2.87 time: 0.028140 Apr 18 20:13:33 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 70/213] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:13:33 2023] GET /compute/v2.1/servers/19e4dcba-70f9-439b-9f92-9891c34e7a87 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1814847736", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "5b16deaf-2b61-4095-91ec-8e78f9af18fe"}]}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] validate_networks() for [('5b16deaf-2b61-4095-91ec-8e78f9af18fe', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for user 4918574af24b49d1b355bd3970ef6be4 and project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:13:33 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:13:33 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-c8396803-e33c-481d-8917-5519577c611b tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.645756 Apr 18 20:13:33 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 76/214] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:13:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 18 20:13:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-67bb7bff-5ecc-486b-b02c-14508846eb17 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-67bb7bff-5ecc-486b-b02c-14508846eb17 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:33 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-67bb7bff-5ecc-486b-b02c-14508846eb17 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:33 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-67bb7bff-5ecc-486b-b02c-14508846eb17 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:33 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-67bb7bff-5ecc-486b-b02c-14508846eb17 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-67bb7bff-5ecc-486b-b02c-14508846eb17 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8" status: 200 len: 1395 microversion: 2.87 time: 0.079509 Apr 18 20:13:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 69/215] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:13:33 2023] GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 => generated 1395 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:13:34 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-8662d06f-9b29-4574-8685-aefe66e11d20 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '.version_select at 0x7fb773ab2f80>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-8662d06f-9b29-4574-8685-aefe66e11d20 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847" status: 204 len: 0 microversion: 2.1 time: 0.199837 Apr 18 20:13:34 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 71/216] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:34 2023] DELETE /compute/v2.1/images/a39d06b3-db73-4fe1-b8c5-44832fbac847 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:34 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:13:34 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-ab2cd8e6-5dde-4c96-a05f-c4f1a4149cfd tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 204 len: 0 microversion: 2.1 time: 0.129829 Apr 18 20:13:34 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 77/217] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:13:34 2023] DELETE /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:34 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:35 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2f19bcf69a6c4abca9f0744965a79d66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1c758096d340d5bc72df80fae46f7d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:35 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bfb19812-75eb-4b69-855b-33b1c0f74a51 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 200 len: 1674 microversion: 2.1 time: 0.323212 Apr 18 20:13:35 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 70/218] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:34 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 1674 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:35 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-dddcade0-ecd1-40da-889d-921fb51e3ff6 req-397a2c58-e1e3-45e7-8077-9d74b49762ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "name": "network-vif-unplugged", "status": "completed", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:35 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-dddcade0-ecd1-40da-889d-921fb51e3ff6 req-397a2c58-e1e3-45e7-8077-9d74b49762ce service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-dddcade0-ecd1-40da-889d-921fb51e3ff6 req-397a2c58-e1e3-45e7-8077-9d74b49762ce service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:35 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-dddcade0-ecd1-40da-889d-921fb51e3ff6 req-397a2c58-e1e3-45e7-8077-9d74b49762ce service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:35 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-dddcade0-ecd1-40da-889d-921fb51e3ff6 req-397a2c58-e1e3-45e7-8077-9d74b49762ce service nova] Creating event network-vif-unplugged:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:13:35 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-dddcade0-ecd1-40da-889d-921fb51e3ff6 req-397a2c58-e1e3-45e7-8077-9d74b49762ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065705 Apr 18 20:13:35 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 72/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:36 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-ee3bd2e1-6960-4b0b-878c-e482b1510bb8 req-d9d0aa95-e1be-492d-bb12-d1eb5afbcc6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:36 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:36 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-ee3bd2e1-6960-4b0b-878c-e482b1510bb8 req-d9d0aa95-e1be-492d-bb12-d1eb5afbcc6d service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:36 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-ee3bd2e1-6960-4b0b-878c-e482b1510bb8 req-d9d0aa95-e1be-492d-bb12-d1eb5afbcc6d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:36 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-ee3bd2e1-6960-4b0b-878c-e482b1510bb8 req-d9d0aa95-e1be-492d-bb12-d1eb5afbcc6d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:36 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:36 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-ee3bd2e1-6960-4b0b-878c-e482b1510bb8 req-d9d0aa95-e1be-492d-bb12-d1eb5afbcc6d service nova] Creating event network-changed:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:13:36 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-ee3bd2e1-6960-4b0b-878c-e482b1510bb8 req-d9d0aa95-e1be-492d-bb12-d1eb5afbcc6d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035690 Apr 18 20:13:36 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 78/220] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "name": "network-vif-plugged", "status": "completed", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}, {"server_uuid": "2fd7c910-7a51-47fc-9d91-14580139817c", "name": "network-vif-deleted", "tag": "9812f23f-1f7c-4dc2-a78c-c0e644382f27"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] Creating event network-vif-plugged:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:13:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] Creating event network-vif-deleted:9812f23f-1f7c-4dc2-a78c-c0e644382f27 for instance 2fd7c910-7a51-47fc-9d91-14580139817c on user Apr 18 20:13:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-de406de4-e09d-4c23-adf5-2fc19b01061f req-d4a7688b-20b0-49fb-bb8d-3c07b6ea0e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036017 Apr 18 20:13:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 71/221] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:37 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:38 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-abfd2916-ed50-4373-b052-253571a08b30 req-4396430e-967d-471c-9a42-b0d76645398d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-abfd2916-ed50-4373-b052-253571a08b30 req-4396430e-967d-471c-9a42-b0d76645398d service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-abfd2916-ed50-4373-b052-253571a08b30 req-4396430e-967d-471c-9a42-b0d76645398d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:38 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-abfd2916-ed50-4373-b052-253571a08b30 req-4396430e-967d-471c-9a42-b0d76645398d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:38 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-abfd2916-ed50-4373-b052-253571a08b30 req-4396430e-967d-471c-9a42-b0d76645398d service nova] Creating event network-vif-plugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:13:38 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-abfd2916-ed50-4373-b052-253571a08b30 req-4396430e-967d-471c-9a42-b0d76645398d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048545 Apr 18 20:13:38 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 73/222] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:40 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-fa3abb58-f3fa-4870-81a9-de38089dcd6a req-ed3e460e-6c1b-4d52-b03c-6d5d29243f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fa3abb58-f3fa-4870-81a9-de38089dcd6a req-ed3e460e-6c1b-4d52-b03c-6d5d29243f0d service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fa3abb58-f3fa-4870-81a9-de38089dcd6a req-ed3e460e-6c1b-4d52-b03c-6d5d29243f0d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-fa3abb58-f3fa-4870-81a9-de38089dcd6a req-ed3e460e-6c1b-4d52-b03c-6d5d29243f0d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-fa3abb58-f3fa-4870-81a9-de38089dcd6a req-ed3e460e-6c1b-4d52-b03c-6d5d29243f0d service nova] Creating event network-vif-plugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:13:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-fa3abb58-f3fa-4870-81a9-de38089dcd6a req-ed3e460e-6c1b-4d52-b03c-6d5d29243f0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037378 Apr 18 20:13:41 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 79/223] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=7 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-612df30d-87ae-464f-a52f-1632bff25e01 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Action: 'create', calling method: .version_select at 0x7fb77389b910>, body: {"keypair": {"name": "tempest-keypair-602955330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjiAr81anpeI49B+eMHdVKtMSr1LLjn27RGrh8du0ZSX2qpxbclGSgY/a1m4ssBtrC47YpupZH86Oj85kgc918yucXfiLg2rsr+heC12QU1xuTy19cmsiy8CvBqQc0Egg=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:48 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-612df30d-87ae-464f-a52f-1632bff25e01 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:48 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-612df30d-87ae-464f-a52f-1632bff25e01 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for user 4859711fcdef4d91ae9caff4bacc85fe and project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-612df30d-87ae-464f-a52f-1632bff25e01 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.157864 Apr 18 20:13:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 72/224] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:13:48 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=3 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=25 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1018798962", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ef116b62-6faf-4010-a37c-960d9a4b6b02"}], "security_groups": [{"name": "tempest-securitygroup--2061636300"}], "key_name": "tempest-keypair-602955330", "user_data": "}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.network.neutron [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] validate_networks() for [('ef116b62-6faf-4010-a37c-960d9a4b6b02', None, None, None, None, None)] {{(pid=61421) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Flavor limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Image limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Flavor pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Image pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for user 4859711fcdef4d91ae9caff4bacc85fe and project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Going to run 1 instances... {{(pid=61421) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:13:50 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:13:50 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-c6c7ee9e-8870-4f84-936e-d8e3fc8cfcbd tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.588052 Apr 18 20:13:50 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 74/225] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:13:49 2023] POST /compute/v2.1/servers => generated 400 bytes in 590 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:13:50 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:50 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:50 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-ac4cbe16-a921-4019-91c6-07e3dadcff3f tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:50 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-ac4cbe16-a921-4019-91c6-07e3dadcff3f tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:50 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-ac4cbe16-a921-4019-91c6-07e3dadcff3f tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:50 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-ac4cbe16-a921-4019-91c6-07e3dadcff3f tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 200 len: 1235 microversion: 2.1 time: 0.068403 Apr 18 20:13:50 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 80/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:50 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:53 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-0f9e63ff-1407-4a44-beee-40a8bb5b25e4 req-a1a6986f-19f1-45a5-8862-a0f2b4ef55eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0f9e63ff-1407-4a44-beee-40a8bb5b25e4 req-a1a6986f-19f1-45a5-8862-a0f2b4ef55eb service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0f9e63ff-1407-4a44-beee-40a8bb5b25e4 req-a1a6986f-19f1-45a5-8862-a0f2b4ef55eb service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:53 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-0f9e63ff-1407-4a44-beee-40a8bb5b25e4 req-a1a6986f-19f1-45a5-8862-a0f2b4ef55eb service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-0f9e63ff-1407-4a44-beee-40a8bb5b25e4 req-a1a6986f-19f1-45a5-8862-a0f2b4ef55eb service nova] Creating event network-changed:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:13:53 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-0f9e63ff-1407-4a44-beee-40a8bb5b25e4 req-a1a6986f-19f1-45a5-8862-a0f2b4ef55eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035367 Apr 18 20:13:53 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 73/227] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:55 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-d8445560-d073-422f-9408-2a2250b18611 req-30e01d3d-90f5-48a4-a684-df87989c240a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "name": "network-vif-plugged", "status": "completed", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d8445560-d073-422f-9408-2a2250b18611 req-30e01d3d-90f5-48a4-a684-df87989c240a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d8445560-d073-422f-9408-2a2250b18611 req-30e01d3d-90f5-48a4-a684-df87989c240a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:55 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d8445560-d073-422f-9408-2a2250b18611 req-30e01d3d-90f5-48a4-a684-df87989c240a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:55 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-d8445560-d073-422f-9408-2a2250b18611 req-30e01d3d-90f5-48a4-a684-df87989c240a service nova] Creating event network-vif-plugged:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:13:55 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-d8445560-d073-422f-9408-2a2250b18611 req-30e01d3d-90f5-48a4-a684-df87989c240a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028978 Apr 18 20:13:55 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 75/228] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:55 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:55 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-5c92fdcc-49af-4b19-b745-7872061a21c8 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 200 len: 1502 microversion: 2.1 time: 0.211635 Apr 18 20:13:55 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 81/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:55 2023] GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:13:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-2a31cbd0-7a5e-4428-93dd-ef20ab4a6614 req-e5a6fa95-2b5d-4b7c-8a26-8c548db67189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "name": "network-vif-plugged", "status": "completed", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2a31cbd0-7a5e-4428-93dd-ef20ab4a6614 req-e5a6fa95-2b5d-4b7c-8a26-8c548db67189 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2a31cbd0-7a5e-4428-93dd-ef20ab4a6614 req-e5a6fa95-2b5d-4b7c-8a26-8c548db67189 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:57 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-2a31cbd0-7a5e-4428-93dd-ef20ab4a6614 req-e5a6fa95-2b5d-4b7c-8a26-8c548db67189 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-2a31cbd0-7a5e-4428-93dd-ef20ab4a6614 req-e5a6fa95-2b5d-4b7c-8a26-8c548db67189 service nova] Creating event network-vif-plugged:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:13:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-2a31cbd0-7a5e-4428-93dd-ef20ab4a6614 req-e5a6fa95-2b5d-4b7c-8a26-8c548db67189 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030128 Apr 18 20:13:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 74/230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:57 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:13:57 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-8f3f0ccf-c301-41b9-87b3-18ded102934d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57" status: 204 len: 0 microversion: 2.1 time: 0.105670 Apr 18 20:13:57 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 76/231] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:13:57 2023] DELETE /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:57 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:58 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-4e9ef296-5259-497d-a55a-3478a12ec5da req-60b4de76-96f3-49d8-9cae-4c259c7d52d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1273ed-7fb4-4e81-90fe-576147c1be57", "name": "network-vif-unplugged", "status": "completed", "tag": "86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:13:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4e9ef296-5259-497d-a55a-3478a12ec5da req-60b4de76-96f3-49d8-9cae-4c259c7d52d2 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:13:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4e9ef296-5259-497d-a55a-3478a12ec5da req-60b4de76-96f3-49d8-9cae-4c259c7d52d2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:13:58 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-4e9ef296-5259-497d-a55a-3478a12ec5da req-60b4de76-96f3-49d8-9cae-4c259c7d52d2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:13:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-4e9ef296-5259-497d-a55a-3478a12ec5da req-60b4de76-96f3-49d8-9cae-4c259c7d52d2 service nova] Creating event network-vif-unplugged:86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5 for instance bf1273ed-7fb4-4e81-90fe-576147c1be57 on user Apr 18 20:13:58 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa0db0e3abe4c74b549c7051a97a3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5a7248acf744b1b289c36e0d684b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:13:58 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-4e9ef296-5259-497d-a55a-3478a12ec5da req-60b4de76-96f3-49d8-9cae-4c259c7d52d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035566 Apr 18 20:13:58 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 75/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:13:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:13:58 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-652df73d-04ac-4f87-934e-7f75a4854869 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57" status: 200 len: 1501 microversion: 2.1 time: 0.291143 Apr 18 20:13:58 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 82/233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:13:57 2023] GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57 => generated 1501 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:00 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf1273ed-7fb4-4e81-90fe-576147c1be57", "name": "network-vif-plugged", "status": "completed", "tag": "86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5"}, {"server_uuid": "bf1273ed-7fb4-4e81-90fe-576147c1be57", "name": "network-vif-deleted", "tag": "86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:00 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:00 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:00 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:00 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] Creating event network-vif-plugged:86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5 for instance bf1273ed-7fb4-4e81-90fe-576147c1be57 on user Apr 18 20:14:00 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] Creating event network-vif-deleted:86014f0c-10d0-46fa-bb2e-0cc8c3b1abc5 for instance bf1273ed-7fb4-4e81-90fe-576147c1be57 on user Apr 18 20:14:00 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-6cc4ae69-38dc-4aaf-8e04-b78183c56199 req-01b612ef-7b52-483c-9d69-46f9a84b70a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029473 Apr 18 20:14:00 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 77/234] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:00 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:07 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:07 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e02fb7c1-c62a-4ea0-a782-dd9e2ad5edd0 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 200 len: 1537 microversion: 2.1 time: 0.220948 Apr 18 20:14:07 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 76/235] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:07 2023] GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 1537 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=11 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=12 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:22 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:22 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-419184a7-ed14-48da-ab31-b8991fc664bf tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.479623 Apr 18 20:14:22 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 83/236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:22 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:24 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:24 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-4d511264-9ee4-4c9b-983e-c3d58cf165a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8" status: 200 len: 1691 microversion: 2.87 time: 0.298745 Apr 18 20:14:24 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 78/237] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:14:24 2023] GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 => generated 1691 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] [instance: 2fd7c910-7a51-47fc-9d91-14580139817c] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] HTTP exception thrown: Instance 2fd7c910-7a51-47fc-9d91-14580139817c could not be found. Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Request method failure captured: Apr 18 20:14:25 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c HTTP/1.1 Apr 18 20:14:25 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:14:25 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:14:25 user devstack@n-api.service[61422]: Connection: close Apr 18 20:14:25 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:14:25 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:14:25 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:14:25 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:14:25 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkGRg-WYIurWYA4OZucjncuiMPNPkpcXOdUW9WBMQ_uK5K4NlkaUQD0Nqht8JY_pEq-ZJf1dpod9V5qTlX49viyeRU2pbzIkw3y1z0lwQW50HqQ3WDzR6D_7obkpCXV1_2EJjPgRTkhCs9iy6kI3k0UtXKlqMV6s1o1W0ZJ8ocgLp8 Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Project-Id: 4e1c758096d340d5bc72df80fae46f7d Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1750167173 Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e1c758096d340d5bc72df80fae46f7d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e1c758096d340d5bc72df80fae46f7d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e1c758096d340d5bc72df80fae46f7d"}]}] Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerStableDeviceRescueTest-1750167173 Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Tenant-Id: 4e1c758096d340d5bc72df80fae46f7d Apr 18 20:14:25 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1750167173 Apr 18 20:14:25 user devstack@n-api.service[61422]: X-User: tempest-ServerStableDeviceRescueTest-1750167173-project-member Apr 18 20:14:25 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:14:25 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:14:25 user devstack@n-api.service[61422]: X-User-Id: 2f19bcf69a6c4abca9f0744965a79d66 Apr 18 20:14:25 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerStableDeviceRescueTest-1750167173-project-member Apr 18 20:14:25 user devstack@n-api.service[61422]: method: > Apr 18 20:14:25 user devstack@n-api.service[61422]: exception: Instance 2fd7c910-7a51-47fc-9d91-14580139817c could not be found. Apr 18 20:14:25 user devstack@n-api.service[61422]: action_args: {'id': '2fd7c910-7a51-47fc-9d91-14580139817c'} Apr 18 20:14:25 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fd7c910-7a51-47fc-9d91-14580139817c could not be found. Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fd7c910-7a51-47fc-9d91-14580139817c could not be found. Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fd7c910-7a51-47fc-9d91-14580139817c could not be found. Apr 18 20:14:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:14:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Returning 404 to user: Instance 2fd7c910-7a51-47fc-9d91-14580139817c could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:14:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d7d2dc6c-a670-4c40-9fc9-f0f612e121f0 tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c" status: 404 len: 111 microversion: 2.1 time: 0.030472 Apr 18 20:14:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 77/238] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:25 2023] GET /compute/v2.1/servers/2fd7c910-7a51-47fc-9d91-14580139817c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:14:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-589fe481-9b57-4712-9d57-51c4f983b29f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] Calling method '.version_select at 0x7fb77399a200>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-589fe481-9b57-4712-9d57-51c4f983b29f tempest-ServerStableDeviceRescueTest-1750167173 tempest-ServerStableDeviceRescueTest-1750167173-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-989202719" status: 202 len: 0 microversion: 2.1 time: 0.021873 Apr 18 20:14:25 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 84/239] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 20:14:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-989202719 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:27 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-11f49fe6-22ec-44e0-af83-884cf7aff3c6 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.192903 Apr 18 20:14:27 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 79/240] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:14:27 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa/os-interface => generated 283 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-13eeefce-11ca-49f3-9b37-2a797afe409b req-3b6b1772-af40-4451-a079-ec0b7a62291a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-13eeefce-11ca-49f3-9b37-2a797afe409b req-3b6b1772-af40-4451-a079-ec0b7a62291a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-13eeefce-11ca-49f3-9b37-2a797afe409b req-3b6b1772-af40-4451-a079-ec0b7a62291a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-13eeefce-11ca-49f3-9b37-2a797afe409b req-3b6b1772-af40-4451-a079-ec0b7a62291a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-13eeefce-11ca-49f3-9b37-2a797afe409b req-3b6b1772-af40-4451-a079-ec0b7a62291a service nova] Creating event network-changed:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:14:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-13eeefce-11ca-49f3-9b37-2a797afe409b req-3b6b1772-af40-4451-a079-ec0b7a62291a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031055 Apr 18 20:14:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 78/241] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-c3e0b7ee-0dd3-4f08-8aab-178c79a0cbff tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa/ips" status: 200 len: 104 microversion: 2.1 time: 0.060656 Apr 18 20:14:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 85/242] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:14:28 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa/ips => generated 104 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:30 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:14:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-18de4983-c5f5-4667-b74c-84b97e4afaeb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 204 len: 0 microversion: 2.1 time: 0.119231 Apr 18 20:14:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 80/243] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:14:30 2023] DELETE /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-dd631c57-1d87-4a74-9986-a39d16af4684 req-7899f18b-3d96-4177-90ec-34639044a8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "name": "network-vif-unplugged", "status": "completed", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dd631c57-1d87-4a74-9986-a39d16af4684 req-7899f18b-3d96-4177-90ec-34639044a8f1 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dd631c57-1d87-4a74-9986-a39d16af4684 req-7899f18b-3d96-4177-90ec-34639044a8f1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dd631c57-1d87-4a74-9986-a39d16af4684 req-7899f18b-3d96-4177-90ec-34639044a8f1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-dd631c57-1d87-4a74-9986-a39d16af4684 req-7899f18b-3d96-4177-90ec-34639044a8f1 service nova] Creating event network-vif-unplugged:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:14:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-dd631c57-1d87-4a74-9986-a39d16af4684 req-7899f18b-3d96-4177-90ec-34639044a8f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030548 Apr 18 20:14:30 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 86/244] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:30 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621a49d58c34c948ee000a94751a585', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4584427b930494cbce6719967c325da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d9dc5a8e-6537-4f6f-a853-40ca7bc8b0a7 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 200 len: 1661 microversion: 2.1 time: 0.406153 Apr 18 20:14:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 79/245] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:30 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 1661 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:31 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:31 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-13d240be-e092-4667-8ff6-6030c658283d tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.210200 Apr 18 20:14:31 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 81/246] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 20:14:31 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8/os-interface => generated 282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:14:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-e1648792-bd28-4420-9ab6-9d73f610e6be req-3d2b7100-0fbf-40bb-87cd-f9f64b8f7325 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-e1648792-bd28-4420-9ab6-9d73f610e6be req-3d2b7100-0fbf-40bb-87cd-f9f64b8f7325 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-e1648792-bd28-4420-9ab6-9d73f610e6be req-3d2b7100-0fbf-40bb-87cd-f9f64b8f7325 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-e1648792-bd28-4420-9ab6-9d73f610e6be req-3d2b7100-0fbf-40bb-87cd-f9f64b8f7325 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-e1648792-bd28-4420-9ab6-9d73f610e6be req-3d2b7100-0fbf-40bb-87cd-f9f64b8f7325 service nova] Creating event network-changed:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:14:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-e1648792-bd28-4420-9ab6-9d73f610e6be req-3d2b7100-0fbf-40bb-87cd-f9f64b8f7325 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028046 Apr 18 20:14:32 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 87/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-8cc6f607-81cd-47b3-b4fb-dcb52d3942da tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8/ips" status: 200 len: 110 microversion: 2.20 time: 0.042809 Apr 18 20:14:32 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 80/248] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 20:14:32 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8/ips => generated 110 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:14:32 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "name": "network-vif-plugged", "status": "completed", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}, {"server_uuid": "ee35542f-80e1-4658-b925-457462c001fa", "name": "network-vif-deleted", "tag": "90ad6020-a9e7-4738-9489-8d21d3bb9107"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] Creating event network-vif-plugged:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:14:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] Creating event network-vif-deleted:90ad6020-a9e7-4738-9489-8d21d3bb9107 for instance ee35542f-80e1-4658-b925-457462c001fa on user Apr 18 20:14:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-b1402c8e-8119-46fc-8949-d94d16691d75 req-dd3fbafb-f33a-4216-87b3-e6f0f03dc8d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039325 Apr 18 20:14:32 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 82/249] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:33 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:14:33 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-e6e8f03a-5140-4375-b614-b5669cefd73c tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 204 len: 0 microversion: 2.20 time: 0.116597 Apr 18 20:14:33 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 88/250] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:14:33 2023] DELETE /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:33 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:34 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:34 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:34 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '14e8456e134e454a82496708ce268345', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88511bc82db742b09c562ca4b6fac0ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-cf7447d7-6fe7-4d8e-bdd2-cdeefb3b747e tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 200 len: 1711 microversion: 2.20 time: 0.190560 Apr 18 20:14:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 81/251] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:14:33 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 1711 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:14:34 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-d46a1de7-5903-4a0a-aa33-94257e291e5d req-3c80d2f3-d350-46e4-847c-9f28c3d3db52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "name": "network-vif-unplugged", "status": "completed", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:34 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d46a1de7-5903-4a0a-aa33-94257e291e5d req-3c80d2f3-d350-46e4-847c-9f28c3d3db52 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:34 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d46a1de7-5903-4a0a-aa33-94257e291e5d req-3c80d2f3-d350-46e4-847c-9f28c3d3db52 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:34 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d46a1de7-5903-4a0a-aa33-94257e291e5d req-3c80d2f3-d350-46e4-847c-9f28c3d3db52 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-d46a1de7-5903-4a0a-aa33-94257e291e5d req-3c80d2f3-d350-46e4-847c-9f28c3d3db52 service nova] Creating event network-vif-unplugged:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:14:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-d46a1de7-5903-4a0a-aa33-94257e291e5d req-3c80d2f3-d350-46e4-847c-9f28c3d3db52 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028354 Apr 18 20:14:34 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 83/252] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:34 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:35 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-efaa2a53-737d-4425-94fd-429dd4076d2b req-113609b7-14c9-4ef3-a7cb-0d940850b280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "name": "network-vif-deleted", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-efaa2a53-737d-4425-94fd-429dd4076d2b req-113609b7-14c9-4ef3-a7cb-0d940850b280 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-efaa2a53-737d-4425-94fd-429dd4076d2b req-113609b7-14c9-4ef3-a7cb-0d940850b280 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-efaa2a53-737d-4425-94fd-429dd4076d2b req-113609b7-14c9-4ef3-a7cb-0d940850b280 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:35 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-efaa2a53-737d-4425-94fd-429dd4076d2b req-113609b7-14c9-4ef3-a7cb-0d940850b280 service nova] Creating event network-vif-deleted:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:14:35 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-efaa2a53-737d-4425-94fd-429dd4076d2b req-113609b7-14c9-4ef3-a7cb-0d940850b280 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036070 Apr 18 20:14:35 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 89/253] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:36 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-31856acf-7b36-4185-af16-594b95e59085 req-d3c5801b-258f-4355-94d1-9797c8c752cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41f28b7f-e090-4a52-a610-58e0a55be9b8", "name": "network-vif-plugged", "status": "completed", "tag": "491d5e69-da12-4822-9003-37b851242837"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-31856acf-7b36-4185-af16-594b95e59085 req-d3c5801b-258f-4355-94d1-9797c8c752cd service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-31856acf-7b36-4185-af16-594b95e59085 req-d3c5801b-258f-4355-94d1-9797c8c752cd service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:36 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-31856acf-7b36-4185-af16-594b95e59085 req-d3c5801b-258f-4355-94d1-9797c8c752cd service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-31856acf-7b36-4185-af16-594b95e59085 req-d3c5801b-258f-4355-94d1-9797c8c752cd service nova] Creating event network-vif-plugged:491d5e69-da12-4822-9003-37b851242837 for instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 on user Apr 18 20:14:36 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-31856acf-7b36-4185-af16-594b95e59085 req-d3c5801b-258f-4355-94d1-9797c8c752cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027436 Apr 18 20:14:36 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 82/254] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:40 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-9d9955c4-5990-41b5-845c-8cd89474e275 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 200 len: 1545 microversion: 2.1 time: 0.301030 Apr 18 20:14:41 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 84/255] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:40 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 1545 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: bf1273ed-7fb4-4e81-90fe-576147c1be57] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] HTTP exception thrown: Instance bf1273ed-7fb4-4e81-90fe-576147c1be57 could not be found. Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Request method failure captured: Apr 18 20:14:48 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57 HTTP/1.1 Apr 18 20:14:48 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:14:48 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:14:48 user devstack@n-api.service[61420]: Connection: close Apr 18 20:14:48 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:14:48 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:14:48 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:14:48 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:14:48 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvkQoQfH5cXeiMj_y5cq4kOjcrcnMtIijyHL4jG6kZsKnQqEJK3DpAMLxkcs86yqH4aZ4xpF5AkHNVJ9_BZ4YioMOpND_8l7f9CE1rsdC_MdT1ut5LE7ys03b_49cxV7UprJKe-ORSsl7w3K1_tnNpDU6B7N3vcmHdSZMsYr_tUmOqU Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Project-Id: da5a7248acf744b1b289c36e0d684b9c Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Project-Name: tempest-VolumesAdminNegativeTest-2034722111 Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da5a7248acf744b1b289c36e0d684b9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da5a7248acf744b1b289c36e0d684b9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da5a7248acf744b1b289c36e0d684b9c"}]}] Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Tenant: tempest-VolumesAdminNegativeTest-2034722111 Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Tenant-Id: da5a7248acf744b1b289c36e0d684b9c Apr 18 20:14:48 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2034722111 Apr 18 20:14:48 user devstack@n-api.service[61420]: X-User: tempest-VolumesAdminNegativeTest-2034722111-project-member Apr 18 20:14:48 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:14:48 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:14:48 user devstack@n-api.service[61420]: X-User-Id: 3aa0db0e3abe4c74b549c7051a97a3fc Apr 18 20:14:48 user devstack@n-api.service[61420]: X-User-Name: tempest-VolumesAdminNegativeTest-2034722111-project-member Apr 18 20:14:48 user devstack@n-api.service[61420]: method: > Apr 18 20:14:48 user devstack@n-api.service[61420]: exception: Instance bf1273ed-7fb4-4e81-90fe-576147c1be57 could not be found. Apr 18 20:14:48 user devstack@n-api.service[61420]: action_args: {'id': 'bf1273ed-7fb4-4e81-90fe-576147c1be57'} Apr 18 20:14:48 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf1273ed-7fb4-4e81-90fe-576147c1be57 could not be found. Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf1273ed-7fb4-4e81-90fe-576147c1be57 could not be found. Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf1273ed-7fb4-4e81-90fe-576147c1be57 could not be found. Apr 18 20:14:48 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Returning 404 to user: Instance bf1273ed-7fb4-4e81-90fe-576147c1be57 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:14:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-866106c0-590f-4010-9e8d-fe2286bae5b7 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57" status: 404 len: 111 microversion: 2.1 time: 0.038166 Apr 18 20:14:48 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 90/256] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:48 2023] GET /compute/v2.1/servers/bf1273ed-7fb4-4e81-90fe-576147c1be57 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=12 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=22 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:14:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6d911abe-40eb-46ce-8065-376145c2e8ba tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105" status: 204 len: 0 microversion: 2.1 time: 0.124364 Apr 18 20:14:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 83/257] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:14:48 2023] DELETE /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aa0db0e3abe4c74b549c7051a97a3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da5a7248acf744b1b289c36e0d684b9c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:48 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-6d47bda7-5cf1-4e39-a220-079585c08d80 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105" status: 200 len: 1668 microversion: 2.1 time: 0.228315 Apr 18 20:14:48 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 85/258] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:48 2023] GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105 => generated 1668 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-c4fa9c92-b482-4647-b418-d01d03be8730 req-d5f5eb89-5ac9-4f85-8c6f-2e8ab14d5b62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "name": "network-vif-unplugged", "status": "completed", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-c4fa9c92-b482-4647-b418-d01d03be8730 req-d5f5eb89-5ac9-4f85-8c6f-2e8ab14d5b62 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-c4fa9c92-b482-4647-b418-d01d03be8730 req-d5f5eb89-5ac9-4f85-8c6f-2e8ab14d5b62 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:48 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-c4fa9c92-b482-4647-b418-d01d03be8730 req-d5f5eb89-5ac9-4f85-8c6f-2e8ab14d5b62 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-c4fa9c92-b482-4647-b418-d01d03be8730 req-d5f5eb89-5ac9-4f85-8c6f-2e8ab14d5b62 service nova] Creating event network-vif-unplugged:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:14:48 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-c4fa9c92-b482-4647-b418-d01d03be8730 req-d5f5eb89-5ac9-4f85-8c6f-2e8ab14d5b62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030092 Apr 18 20:14:48 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 91/259] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-c4cd46d5-a254-4c28-a7c3-215793dfd7c0 req-a4ed34d0-15bd-480c-baa1-b8a6dda68a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "name": "network-vif-deleted", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c4cd46d5-a254-4c28-a7c3-215793dfd7c0 req-a4ed34d0-15bd-480c-baa1-b8a6dda68a8a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c4cd46d5-a254-4c28-a7c3-215793dfd7c0 req-a4ed34d0-15bd-480c-baa1-b8a6dda68a8a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-c4cd46d5-a254-4c28-a7c3-215793dfd7c0 req-a4ed34d0-15bd-480c-baa1-b8a6dda68a8a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-c4cd46d5-a254-4c28-a7c3-215793dfd7c0 req-a4ed34d0-15bd-480c-baa1-b8a6dda68a8a service nova] Creating event network-vif-deleted:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:14:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-c4cd46d5-a254-4c28-a7c3-215793dfd7c0 req-a4ed34d0-15bd-480c-baa1-b8a6dda68a8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028278 Apr 18 20:14:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 84/260] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:51 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-0ff2c3ab-8246-4681-aba1-876667ec9678 req-d5cc5f65-da8d-4413-9b88-86a5fefd8e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce20a973-40ca-41ce-a505-25ac9915f105", "name": "network-vif-plugged", "status": "completed", "tag": "78a48b5e-7d35-4e86-922a-96f0d9eee96e"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:51 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-0ff2c3ab-8246-4681-aba1-876667ec9678 req-d5cc5f65-da8d-4413-9b88-86a5fefd8e4f service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:51 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-0ff2c3ab-8246-4681-aba1-876667ec9678 req-d5cc5f65-da8d-4413-9b88-86a5fefd8e4f service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:51 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-0ff2c3ab-8246-4681-aba1-876667ec9678 req-d5cc5f65-da8d-4413-9b88-86a5fefd8e4f service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-0ff2c3ab-8246-4681-aba1-876667ec9678 req-d5cc5f65-da8d-4413-9b88-86a5fefd8e4f service nova] Creating event network-vif-plugged:78a48b5e-7d35-4e86-922a-96f0d9eee96e for instance ce20a973-40ca-41ce-a505-25ac9915f105 on user Apr 18 20:14:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-0ff2c3ab-8246-4681-aba1-876667ec9678 req-d5cc5f65-da8d-4413-9b88-86a5fefd8e4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030381 Apr 18 20:14:51 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 86/261] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:56 user devstack@n-api.service[61420]: DEBUG nova.objects.instance [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lazy-loading 'flavor' on Instance uuid 6c0a5bc6-4536-4952-a5bd-990622ad400e {{(pid=61420) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 20:14:56 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-35f6d6b3-c22a-4491-bd58-0d8bdbdfd79c tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e/action" status: 200 len: 32 microversion: 2.1 time: 0.141784 Apr 18 20:14:56 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 92/262] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 20:14:56 2023] POST /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:56 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:14:56 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-dde0bed3-f3ae-4cb0-acff-218ad77edb80 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 200 len: 1508 microversion: 2.1 time: 0.690408 Apr 18 20:14:56 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 85/263] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:14:56 2023] GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 1508 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:14:57 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-7df8646f-3ec2-4793-882e-eb00bde5049b req-e2b139bf-7fb8-4ffe-9ae1-9c4c1fd593f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-unplugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:57 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-7df8646f-3ec2-4793-882e-eb00bde5049b req-e2b139bf-7fb8-4ffe-9ae1-9c4c1fd593f9 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-7df8646f-3ec2-4793-882e-eb00bde5049b req-e2b139bf-7fb8-4ffe-9ae1-9c4c1fd593f9 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:57 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-7df8646f-3ec2-4793-882e-eb00bde5049b req-e2b139bf-7fb8-4ffe-9ae1-9c4c1fd593f9 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:57 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:14:57 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-7df8646f-3ec2-4793-882e-eb00bde5049b req-e2b139bf-7fb8-4ffe-9ae1-9c4c1fd593f9 service nova] Creating event network-vif-unplugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:14:57 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-7df8646f-3ec2-4793-882e-eb00bde5049b req-e2b139bf-7fb8-4ffe-9ae1-9c4c1fd593f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.176048 Apr 18 20:14:57 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 87/264] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:14:59 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-1614db73-3222-419a-86a3-53cc4cc97510 req-48409de7-c16d-4433-926d-c0e404376644 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:14:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-1614db73-3222-419a-86a3-53cc4cc97510 req-48409de7-c16d-4433-926d-c0e404376644 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:14:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-1614db73-3222-419a-86a3-53cc4cc97510 req-48409de7-c16d-4433-926d-c0e404376644 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:14:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-1614db73-3222-419a-86a3-53cc4cc97510 req-48409de7-c16d-4433-926d-c0e404376644 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:14:59 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-1614db73-3222-419a-86a3-53cc4cc97510 req-48409de7-c16d-4433-926d-c0e404376644 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:14:59 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-1614db73-3222-419a-86a3-53cc4cc97510 req-48409de7-c16d-4433-926d-c0e404376644 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031974 Apr 18 20:14:59 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 93/265] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:14:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:15:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:15:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-8ff852c4-3a2e-4ca8-b0bf-de7e2e9d7d99 req-72b2e2ee-a860-48d0-b911-d37dca37e490 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033629 Apr 18 20:15:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 86/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:01 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:08 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:08 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-ea01c252-a3a0-4097-ace2-45a207b3a8a8 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 200 len: 1537 microversion: 2.1 time: 0.232537 Apr 18 20:15:08 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 88/267] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:08 2023] GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 1537 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Searching by: {'deleted': False, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4'} {{(pid=61420) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:08 user devstack@n-api.service[61420]: DEBUG nova.compute.multi_cell_list [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61420) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 20:15:08 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-e28d83c6-4e0d-4a70-8e42-4f00bcf0e106 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.186834 Apr 18 20:15:08 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 94/268] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 20:15:08 2023] GET /compute/v2.1/servers => generated 341 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:08 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:08 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d92a7178-b3ca-403f-86cd-3fac1896cf2d tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 200 len: 1537 microversion: 2.1 time: 0.138525 Apr 18 20:15:08 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 87/269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:08 2023] GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 1537 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:10 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:15:10 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-e0dc79ed-d2b6-41a1-9f00-f5dbd47d5069 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 204 len: 0 microversion: 2.1 time: 0.113466 Apr 18 20:15:10 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 89/270] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:15:10 2023] DELETE /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f9070731-fc95-40e4-be3d-66ccbd12f4ff req-3872229e-2d12-465d-8ead-0268d4d9fdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd23717-f912-486a-8a0f-983edcbf5ba2", "name": "network-vif-unplugged", "status": "completed", "tag": "56b439b1-1255-4f49-ae1b-26bee78f2efe"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f9070731-fc95-40e4-be3d-66ccbd12f4ff req-3872229e-2d12-465d-8ead-0268d4d9fdc2 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f9070731-fc95-40e4-be3d-66ccbd12f4ff req-3872229e-2d12-465d-8ead-0268d4d9fdc2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f9070731-fc95-40e4-be3d-66ccbd12f4ff req-3872229e-2d12-465d-8ead-0268d4d9fdc2 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f9070731-fc95-40e4-be3d-66ccbd12f4ff req-3872229e-2d12-465d-8ead-0268d4d9fdc2 service nova] Creating event network-vif-unplugged:56b439b1-1255-4f49-ae1b-26bee78f2efe for instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 on user Apr 18 20:15:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f9070731-fc95-40e4-be3d-66ccbd12f4ff req-3872229e-2d12-465d-8ead-0268d4d9fdc2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038917 Apr 18 20:15:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 88/271] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:10 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '48ac512f13754a49bde814ba9e7103ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ad73ba40edd4087aff9ae96a69e10c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:10 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-f0cfc52e-4083-4c64-8c05-60bf8e818032 tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 200 len: 1543 microversion: 2.1 time: 0.444645 Apr 18 20:15:10 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 95/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:10 2023] GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 1543 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:12 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cd23717-f912-486a-8a0f-983edcbf5ba2", "name": "network-vif-plugged", "status": "completed", "tag": "56b439b1-1255-4f49-ae1b-26bee78f2efe"}, {"server_uuid": "8cd23717-f912-486a-8a0f-983edcbf5ba2", "name": "network-vif-deleted", "tag": "56b439b1-1255-4f49-ae1b-26bee78f2efe"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:12 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:12 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] Creating event network-vif-plugged:56b439b1-1255-4f49-ae1b-26bee78f2efe for instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 on user Apr 18 20:15:12 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] Creating event network-vif-deleted:56b439b1-1255-4f49-ae1b-26bee78f2efe for instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 on user Apr 18 20:15:12 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-fad6fbeb-72e2-4cf7-b5fc-166da808f7d7 req-7a858e4a-6187-4a7d-a345-3c205636369c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030299 Apr 18 20:15:12 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 90/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:12 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:20 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] HTTP exception thrown: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Request method failure captured: Apr 18 20:15:21 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa HTTP/1.1 Apr 18 20:15:21 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:15:21 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:15:21 user devstack@n-api.service[61422]: Connection: close Apr 18 20:15:21 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:15:21 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:15:21 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:15:21 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:15:21 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkGWUUQzfSno_YOVGDqk58WBdkwEuDgkfz5muo8XailtvReSl6pBx-RI0U6U1M63Dmjoa_U70cU4sweSvS6yT1L8HBzzq92myKnXl6mQgmMK3z2hiJRv9wUzvd4_KEUDstq3dunXDWN-jr7jYJUOjXu6AWbSB7BoxeIhp0MssHwo88 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a4584427b930494cbce6719967c325da"}]}] Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Tenant-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Id: 2621a49d58c34c948ee000a94751a585 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:21 user devstack@n-api.service[61422]: method: > Apr 18 20:15:21 user devstack@n-api.service[61422]: exception: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: action_args: {'id': 'ee35542f-80e1-4658-b925-457462c001fa'} Apr 18 20:15:21 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Returning 404 to user: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e9388ff9-ca93-4439-a5bc-7cb1a2e0242e tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 404 len: 111 microversion: 2.1 time: 0.196550 Apr 18 20:15:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 89/274] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:20 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:15:21 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-fe10dc21-f568-4245-b1f1-75349210a827 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '.version_select at 0x7fb773999fc0>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=12 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:21 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-fe10dc21-f568-4245-b1f1-75349210a827 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141630914" status: 202 len: 0 microversion: 2.1 time: 0.031842 Apr 18 20:15:21 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 96/275] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 20:15:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2141630914 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:21 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] HTTP exception thrown: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Request method failure captured: Apr 18 20:15:21 user devstack@n-api.service[61421]: request: DELETE /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa HTTP/1.1 Apr 18 20:15:21 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:15:21 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:15:21 user devstack@n-api.service[61421]: Connection: close Apr 18 20:15:21 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:15:21 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:15:21 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:15:21 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:15:21 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkGWUUQzfSno_YOVGDqk58WBdkwEuDgkfz5muo8XailtvReSl6pBx-RI0U6U1M63Dmjoa_U70cU4sweSvS6yT1L8HBzzq92myKnXl6mQgmMK3z2hiJRv9wUzvd4_KEUDstq3dunXDWN-jr7jYJUOjXu6AWbSB7BoxeIhp0MssHwo88 Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Project-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Project-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a4584427b930494cbce6719967c325da"}]}] Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Tenant: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Tenant-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:21 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61421]: X-User: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:21 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:15:21 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:15:21 user devstack@n-api.service[61421]: X-User-Id: 2621a49d58c34c948ee000a94751a585 Apr 18 20:15:21 user devstack@n-api.service[61421]: X-User-Name: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:21 user devstack@n-api.service[61421]: method: > Apr 18 20:15:21 user devstack@n-api.service[61421]: exception: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61421]: action_args: {'id': 'ee35542f-80e1-4658-b925-457462c001fa'} Apr 18 20:15:21 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Returning 404 to user: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:21 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-6c04f8b4-00e0-44a0-9f35-56f6364aae14 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 404 len: 111 microversion: 2.1 time: 0.030534 Apr 18 20:15:21 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 91/276] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:15:21 2023] DELETE /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: ee35542f-80e1-4658-b925-457462c001fa] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] HTTP exception thrown: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Request method failure captured: Apr 18 20:15:21 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa HTTP/1.1 Apr 18 20:15:21 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:15:21 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:15:21 user devstack@n-api.service[61422]: Connection: close Apr 18 20:15:21 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:15:21 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:15:21 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:15:21 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:15:21 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkGWUUQzfSno_YOVGDqk58WBdkwEuDgkfz5muo8XailtvReSl6pBx-RI0U6U1M63Dmjoa_U70cU4sweSvS6yT1L8HBzzq92myKnXl6mQgmMK3z2hiJRv9wUzvd4_KEUDstq3dunXDWN-jr7jYJUOjXu6AWbSB7BoxeIhp0MssHwo88 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a4584427b930494cbce6719967c325da"}]}] Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Tenant-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:21 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Id: 2621a49d58c34c948ee000a94751a585 Apr 18 20:15:21 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:21 user devstack@n-api.service[61422]: method: > Apr 18 20:15:21 user devstack@n-api.service[61422]: exception: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:21 user devstack@n-api.service[61422]: action_args: {'id': 'ee35542f-80e1-4658-b925-457462c001fa'} Apr 18 20:15:21 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:21 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. Apr 18 20:15:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Returning 404 to user: Instance ee35542f-80e1-4658-b925-457462c001fa could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-0efdd6af-a110-448c-8b20-345f4aa272fb tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa" status: 404 len: 111 microversion: 2.1 time: 0.030399 Apr 18 20:15:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 90/277] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:21 2023] GET /compute/v2.1/servers/ee35542f-80e1-4658-b925-457462c001fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] HTTP exception thrown: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Request method failure captured: Apr 18 20:15:22 user devstack@n-api.service[61420]: request: DELETE /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 HTTP/1.1 Apr 18 20:15:22 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:15:22 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:15:22 user devstack@n-api.service[61420]: Connection: close Apr 18 20:15:22 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:15:22 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:15:22 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:15:22 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:15:22 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvkGWUUQzfSno_YOVGDqk58WBdkwEuDgkfz5muo8XailtvReSl6pBx-RI0U6U1M63Dmjoa_U70cU4sweSvS6yT1L8HBzzq92myKnXl6mQgmMK3z2hiJRv9wUzvd4_KEUDstq3dunXDWN-jr7jYJUOjXu6AWbSB7BoxeIhp0MssHwo88 Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Project-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a4584427b930494cbce6719967c325da"}]}] Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Tenant-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:22 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:22 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:22 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:15:22 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:15:22 user devstack@n-api.service[61420]: X-User-Id: 2621a49d58c34c948ee000a94751a585 Apr 18 20:15:22 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:22 user devstack@n-api.service[61420]: method: > Apr 18 20:15:22 user devstack@n-api.service[61420]: exception: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61420]: action_args: {'id': '8764c1af-455f-4d21-9bd4-604ff561f656'} Apr 18 20:15:22 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Returning 404 to user: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:22 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-315567d4-c7dc-41af-baea-266400dfb6c3 tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 404 len: 111 microversion: 2.1 time: 0.032277 Apr 18 20:15:22 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 97/278] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:15:22 2023] DELETE /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] [instance: 8764c1af-455f-4d21-9bd4-604ff561f656] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] HTTP exception thrown: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Request method failure captured: Apr 18 20:15:22 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 HTTP/1.1 Apr 18 20:15:22 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:15:22 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:15:22 user devstack@n-api.service[61421]: Connection: close Apr 18 20:15:22 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:15:22 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:15:22 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:15:22 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:15:22 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkGWUUQzfSno_YOVGDqk58WBdkwEuDgkfz5muo8XailtvReSl6pBx-RI0U6U1M63Dmjoa_U70cU4sweSvS6yT1L8HBzzq92myKnXl6mQgmMK3z2hiJRv9wUzvd4_KEUDstq3dunXDWN-jr7jYJUOjXu6AWbSB7BoxeIhp0MssHwo88 Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Project-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Project-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/a4584427b930494cbce6719967c325da"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/a4584427b930494cbce6719967c325da"}]}] Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Tenant: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Tenant-Id: a4584427b930494cbce6719967c325da Apr 18 20:15:22 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-AttachVolumeTestJSON-520167989 Apr 18 20:15:22 user devstack@n-api.service[61421]: X-User: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:22 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:15:22 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:15:22 user devstack@n-api.service[61421]: X-User-Id: 2621a49d58c34c948ee000a94751a585 Apr 18 20:15:22 user devstack@n-api.service[61421]: X-User-Name: tempest-AttachVolumeTestJSON-520167989-project-member Apr 18 20:15:22 user devstack@n-api.service[61421]: method: > Apr 18 20:15:22 user devstack@n-api.service[61421]: exception: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61421]: action_args: {'id': '8764c1af-455f-4d21-9bd4-604ff561f656'} Apr 18 20:15:22 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. Apr 18 20:15:22 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:15:22 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] Returning 404 to user: Instance 8764c1af-455f-4d21-9bd4-604ff561f656 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:22 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-ddf1a33a-7d64-4d26-9c9e-3845cff7a0df tempest-AttachVolumeTestJSON-520167989 tempest-AttachVolumeTestJSON-520167989-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656" status: 404 len: 111 microversion: 2.1 time: 0.029585 Apr 18 20:15:22 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 92/279] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:22 2023] GET /compute/v2.1/servers/8764c1af-455f-4d21-9bd4-604ff561f656 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d0860bba-d737-41c8-bfd3-b112807b6401 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.215783 Apr 18 20:15:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 91/280] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:22 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:23 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:23 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-995ff448-01ae-4ed6-a04f-81b6e3de3aa8 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.155925 Apr 18 20:15:23 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 98/281] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:22 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:23 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:23 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-6f9eb85d-9dae-4f64-8ef3-6dde72c7a0fd tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.180623 Apr 18 20:15:23 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 93/282] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:23 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] HTTP exception thrown: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Request method failure captured: Apr 18 20:15:24 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 HTTP/1.1 Apr 18 20:15:24 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:15:24 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:15:24 user devstack@n-api.service[61422]: Connection: close Apr 18 20:15:24 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:15:24 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:15:24 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:15:24 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:15:24 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkHAX878cEj9r5MplKxjiMUJHtoQvZmpQ7BniVySWiLb6QMi62v1ypUdfWbgvKO0OIjna3DgwN8JbS901D1_8dkZMaO5WKyw622KoYNsYCPa1AVEKhgvL8RLljhFL3CmjqGuMIpleDTC6Uatzr5SKccbDW6joLfSruQAKIwUWkidzg Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Project-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88511bc82db742b09c562ca4b6fac0ef"}]}] Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Tenant-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:24 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:24 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:24 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:15:24 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:15:24 user devstack@n-api.service[61422]: X-User-Id: 14e8456e134e454a82496708ce268345 Apr 18 20:15:24 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:24 user devstack@n-api.service[61422]: method: > Apr 18 20:15:24 user devstack@n-api.service[61422]: exception: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:24 user devstack@n-api.service[61422]: action_args: {'id': '41f28b7f-e090-4a52-a610-58e0a55be9b8'} Apr 18 20:15:24 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:24 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Returning 404 to user: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-96335cd3-50cb-43ef-b290-bb9a9ceb251a tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 404 len: 111 microversion: 2.20 time: 0.144747 Apr 18 20:15:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 92/283] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:15:24 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:15:24 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-328d8ab3-7588-4d62-a8d7-093eb2790cad tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '.version_select at 0x7fb77399b640>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:24 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-328d8ab3-7588-4d62-a8d7-093eb2790cad tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-411596916" status: 204 len: 0 microversion: 2.20 time: 0.028541 Apr 18 20:15:24 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 99/284] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 20:15:24 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-411596916 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-724122902"}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] HTTP exception thrown: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Request method failure captured: Apr 18 20:15:25 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 HTTP/1.1 Apr 18 20:15:25 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:15:25 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:15:25 user devstack@n-api.service[61422]: Connection: close Apr 18 20:15:25 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:15:25 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:15:25 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:15:25 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:15:25 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkHAX878cEj9r5MplKxjiMUJHtoQvZmpQ7BniVySWiLb6QMi62v1ypUdfWbgvKO0OIjna3DgwN8JbS901D1_8dkZMaO5WKyw622KoYNsYCPa1AVEKhgvL8RLljhFL3CmjqGuMIpleDTC6Uatzr5SKccbDW6joLfSruQAKIwUWkidzg Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88511bc82db742b09c562ca4b6fac0ef"}]}] Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Tenant-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Id: 14e8456e134e454a82496708ce268345 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61422]: method: > Apr 18 20:15:25 user devstack@n-api.service[61422]: exception: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: action_args: {'id': '41f28b7f-e090-4a52-a610-58e0a55be9b8'} Apr 18 20:15:25 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Returning 404 to user: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d90e973e-3b44-4964-95c9-0cfbb2a0da74 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 404 len: 111 microversion: 2.20 time: 0.031886 Apr 18 20:15:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 93/285] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:15:25 2023] DELETE /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: 41f28b7f-e090-4a52-a610-58e0a55be9b8] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] HTTP exception thrown: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Request method failure captured: Apr 18 20:15:25 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 HTTP/1.1 Apr 18 20:15:25 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:15:25 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:15:25 user devstack@n-api.service[61420]: Connection: close Apr 18 20:15:25 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:15:25 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:15:25 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:15:25 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:15:25 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvkHAX878cEj9r5MplKxjiMUJHtoQvZmpQ7BniVySWiLb6QMi62v1ypUdfWbgvKO0OIjna3DgwN8JbS901D1_8dkZMaO5WKyw622KoYNsYCPa1AVEKhgvL8RLljhFL3CmjqGuMIpleDTC6Uatzr5SKccbDW6joLfSruQAKIwUWkidzg Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88511bc82db742b09c562ca4b6fac0ef"}]}] Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Tenant-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Id: 14e8456e134e454a82496708ce268345 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61420]: method: > Apr 18 20:15:25 user devstack@n-api.service[61420]: exception: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: action_args: {'id': '41f28b7f-e090-4a52-a610-58e0a55be9b8'} Apr 18 20:15:25 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Returning 404 to user: Instance 41f28b7f-e090-4a52-a610-58e0a55be9b8 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-7603da24-2d3e-42b7-a301-0963ac626ced tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8" status: 404 len: 111 microversion: 2.20 time: 0.027731 Apr 18 20:15:25 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 100/286] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:15:25 2023] GET /compute/v2.1/servers/41f28b7f-e090-4a52-a610-58e0a55be9b8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-43b9acbb-e253-479f-9f1c-847d9ddaffdd tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "POST /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8/action" status: 202 len: 52 microversion: 2.87 time: 1.012506 Apr 18 20:15:25 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 94/287] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 20:15:24 2023] POST /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8/action => generated 52 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] HTTP exception thrown: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Request method failure captured: Apr 18 20:15:25 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 HTTP/1.1 Apr 18 20:15:25 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:15:25 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:15:25 user devstack@n-api.service[61422]: Connection: close Apr 18 20:15:25 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:15:25 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:15:25 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:15:25 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:15:25 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkHAX878cEj9r5MplKxjiMUJHtoQvZmpQ7BniVySWiLb6QMi62v1ypUdfWbgvKO0OIjna3DgwN8JbS901D1_8dkZMaO5WKyw622KoYNsYCPa1AVEKhgvL8RLljhFL3CmjqGuMIpleDTC6Uatzr5SKccbDW6joLfSruQAKIwUWkidzg Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88511bc82db742b09c562ca4b6fac0ef"}]}] Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Tenant-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Id: 14e8456e134e454a82496708ce268345 Apr 18 20:15:25 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61422]: method: > Apr 18 20:15:25 user devstack@n-api.service[61422]: exception: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: action_args: {'id': 'cca4f2c5-3084-4356-b066-56c998d051d0'} Apr 18 20:15:25 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Returning 404 to user: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6ef25e59-d5d1-429d-8bf0-30ab7ba5a052 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 404 len: 111 microversion: 2.20 time: 0.033105 Apr 18 20:15:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 94/288] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:15:25 2023] DELETE /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] [instance: cca4f2c5-3084-4356-b066-56c998d051d0] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] HTTP exception thrown: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Request method failure captured: Apr 18 20:15:25 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 HTTP/1.1 Apr 18 20:15:25 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:15:25 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:15:25 user devstack@n-api.service[61420]: Connection: close Apr 18 20:15:25 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:15:25 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:15:25 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:15:25 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:15:25 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvkHAX878cEj9r5MplKxjiMUJHtoQvZmpQ7BniVySWiLb6QMi62v1ypUdfWbgvKO0OIjna3DgwN8JbS901D1_8dkZMaO5WKyw622KoYNsYCPa1AVEKhgvL8RLljhFL3CmjqGuMIpleDTC6Uatzr5SKccbDW6joLfSruQAKIwUWkidzg Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88511bc82db742b09c562ca4b6fac0ef"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88511bc82db742b09c562ca4b6fac0ef"}]}] Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Tenant-Id: 88511bc82db742b09c562ca4b6fac0ef Apr 18 20:15:25 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1629260863 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Id: 14e8456e134e454a82496708ce268345 Apr 18 20:15:25 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1629260863-project-member Apr 18 20:15:25 user devstack@n-api.service[61420]: method: > Apr 18 20:15:25 user devstack@n-api.service[61420]: exception: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: action_args: {'id': 'cca4f2c5-3084-4356-b066-56c998d051d0'} Apr 18 20:15:25 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. Apr 18 20:15:25 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:15:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] Returning 404 to user: Instance cca4f2c5-3084-4356-b066-56c998d051d0 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-68e43705-4af9-4360-8ca2-78c463be80e5 tempest-AttachVolumeShelveTestJSON-1629260863 tempest-AttachVolumeShelveTestJSON-1629260863-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0" status: 404 len: 111 microversion: 2.20 time: 0.026397 Apr 18 20:15:25 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 101/289] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:15:25 2023] GET /compute/v2.1/servers/cca4f2c5-3084-4356-b066-56c998d051d0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:30 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-80abc325-8793-4629-afad-a3ccc5c73faa tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8" status: 200 len: 1691 microversion: 2.87 time: 0.283455 Apr 18 20:15:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 95/290] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:15:30 2023] GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 => generated 1691 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 20:15:33 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-64574053", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "f4bc5e90-ad78-4df5-b395-3dbab88574ad"}]}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:33 user devstack@n-api.service[61422]: DEBUG nova.network.neutron [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] validate_networks() for [('f4bc5e90-ad78-4df5-b395-3dbab88574ad', None, None, None, None, None)] {{(pid=61422) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Flavor limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Image limits 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Flavor pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Image pref 0:0:0 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.virt.hardware [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61422) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Getting quotas for project 12026d2f47254305a57bde39cbb038f8. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Getting quotas for user e891b948918d4beca7a9215d8e536a3a and project 12026d2f47254305a57bde39cbb038f8. Resources: {'cores', 'ram', 'instances'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Going to run 1 instances... {{(pid=61422) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:15:34 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61422) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:15:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-840e1209-6ba3-4ee4-8ebf-e1e195658de4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.996088 Apr 18 20:15:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 95/291] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:15:33 2023] POST /compute/v2.1/servers => generated 378 bytes in 997 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:15:34 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e35edb6e-c0b3-4778-ac7f-c04a1a655580 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:34 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-e35edb6e-c0b3-4778-ac7f-c04a1a655580 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:34 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-e35edb6e-c0b3-4778-ac7f-c04a1a655580 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e891b948918d4beca7a9215d8e536a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12026d2f47254305a57bde39cbb038f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:34 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-e35edb6e-c0b3-4778-ac7f-c04a1a655580 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4" status: 200 len: 1206 microversion: 2.1 time: 0.071342 Apr 18 20:15:34 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 102/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:34 2023] GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4 => generated 1206 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:37 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-22c3d594-fe39-45a3-99e5-e74270eeb8f0 req-cfb14d2e-954d-4b8f-93f0-47e41a779ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "064455cd-15c5-4da7-a569-4f1e098e62d4", "tag": "048ae78d-29a8-4bc8-9721-6f6286f9872c"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-22c3d594-fe39-45a3-99e5-e74270eeb8f0 req-cfb14d2e-954d-4b8f-93f0-47e41a779ee7 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-22c3d594-fe39-45a3-99e5-e74270eeb8f0 req-cfb14d2e-954d-4b8f-93f0-47e41a779ee7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-22c3d594-fe39-45a3-99e5-e74270eeb8f0 req-cfb14d2e-954d-4b8f-93f0-47e41a779ee7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:37 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-22c3d594-fe39-45a3-99e5-e74270eeb8f0 req-cfb14d2e-954d-4b8f-93f0-47e41a779ee7 service nova] Creating event network-changed:048ae78d-29a8-4bc8-9721-6f6286f9872c for instance 064455cd-15c5-4da7-a569-4f1e098e62d4 on user Apr 18 20:15:37 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-22c3d594-fe39-45a3-99e5-e74270eeb8f0 req-cfb14d2e-954d-4b8f-93f0-47e41a779ee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030523 Apr 18 20:15:37 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 96/293] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:38 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:38 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] [instance: ce20a973-40ca-41ce-a505-25ac9915f105] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:38 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:39 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] HTTP exception thrown: Instance ce20a973-40ca-41ce-a505-25ac9915f105 could not be found. Apr 18 20:15:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Request method failure captured: Apr 18 20:15:39 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105 HTTP/1.1 Apr 18 20:15:39 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:15:39 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:15:39 user devstack@n-api.service[61422]: Connection: close Apr 18 20:15:39 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:15:39 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:15:39 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:15:39 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:15:39 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkQoQfH5cXeiMj_y5cq4kOjcrcnMtIijyHL4jG6kZsKnQqEJK3DpAMLxkcs86yqH4aZ4xpF5AkHNVJ9_BZ4YioMOpND_8l7f9CE1rsdC_MdT1ut5LE7ys03b_49cxV7UprJKe-ORSsl7w3K1_tnNpDU6B7N3vcmHdSZMsYr_tUmOqU Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Project-Id: da5a7248acf744b1b289c36e0d684b9c Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesAdminNegativeTest-2034722111 Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da5a7248acf744b1b289c36e0d684b9c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/da5a7248acf744b1b289c36e0d684b9c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/da5a7248acf744b1b289c36e0d684b9c"}]}] Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesAdminNegativeTest-2034722111 Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Tenant-Id: da5a7248acf744b1b289c36e0d684b9c Apr 18 20:15:39 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2034722111 Apr 18 20:15:39 user devstack@n-api.service[61422]: X-User: tempest-VolumesAdminNegativeTest-2034722111-project-member Apr 18 20:15:39 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:15:39 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:15:39 user devstack@n-api.service[61422]: X-User-Id: 3aa0db0e3abe4c74b549c7051a97a3fc Apr 18 20:15:39 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesAdminNegativeTest-2034722111-project-member Apr 18 20:15:39 user devstack@n-api.service[61422]: method: > Apr 18 20:15:39 user devstack@n-api.service[61422]: exception: Instance ce20a973-40ca-41ce-a505-25ac9915f105 could not be found. Apr 18 20:15:39 user devstack@n-api.service[61422]: action_args: {'id': 'ce20a973-40ca-41ce-a505-25ac9915f105'} Apr 18 20:15:39 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce20a973-40ca-41ce-a505-25ac9915f105 could not be found. Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce20a973-40ca-41ce-a505-25ac9915f105 could not be found. Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce20a973-40ca-41ce-a505-25ac9915f105 could not be found. Apr 18 20:15:39 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:15:39 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Returning 404 to user: Instance ce20a973-40ca-41ce-a505-25ac9915f105 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:15:39 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4df16e54-79e4-4adf-9dec-68b68385503d tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105" status: 404 len: 111 microversion: 2.1 time: 0.267663 Apr 18 20:15:39 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 96/294] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:38 2023] GET /compute/v2.1/servers/ce20a973-40ca-41ce-a505-25ac9915f105 => generated 111 bytes in 269 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:15:39 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-3cded690-b902-486a-8855-120f649cf5e5 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] Calling method '.version_select at 0x7fb77399be20>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:39 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=12 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-3cded690-b902-486a-8855-120f649cf5e5 tempest-VolumesAdminNegativeTest-2034722111 tempest-VolumesAdminNegativeTest-2034722111-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851809297" status: 202 len: 0 microversion: 2.1 time: 0.025714 Apr 18 20:15:39 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 103/295] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 20:15:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1851809297 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:15:39 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-4b62f0ac-bf40-4802-9c85-e388cf57eae1 req-6f0d4778-d8f7-4ad3-8aae-ab37e257bd9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064455cd-15c5-4da7-a569-4f1e098e62d4", "name": "network-vif-plugged", "status": "completed", "tag": "048ae78d-29a8-4bc8-9721-6f6286f9872c"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:39 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-4b62f0ac-bf40-4802-9c85-e388cf57eae1 req-6f0d4778-d8f7-4ad3-8aae-ab37e257bd9a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-4b62f0ac-bf40-4802-9c85-e388cf57eae1 req-6f0d4778-d8f7-4ad3-8aae-ab37e257bd9a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-4b62f0ac-bf40-4802-9c85-e388cf57eae1 req-6f0d4778-d8f7-4ad3-8aae-ab37e257bd9a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:39 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:39 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-4b62f0ac-bf40-4802-9c85-e388cf57eae1 req-6f0d4778-d8f7-4ad3-8aae-ab37e257bd9a service nova] Creating event network-vif-plugged:048ae78d-29a8-4bc8-9721-6f6286f9872c for instance 064455cd-15c5-4da7-a569-4f1e098e62d4 on user Apr 18 20:15:39 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-4b62f0ac-bf40-4802-9c85-e388cf57eae1 req-6f0d4778-d8f7-4ad3-8aae-ab37e257bd9a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034190 Apr 18 20:15:39 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 97/296] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:41 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-b0f4422c-d2b0-4c9a-83d7-e6612fc4e548 req-7dc3e2d2-8869-4cb3-8580-5503af30bb4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064455cd-15c5-4da7-a569-4f1e098e62d4", "name": "network-vif-plugged", "status": "completed", "tag": "048ae78d-29a8-4bc8-9721-6f6286f9872c"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b0f4422c-d2b0-4c9a-83d7-e6612fc4e548 req-7dc3e2d2-8869-4cb3-8580-5503af30bb4e service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b0f4422c-d2b0-4c9a-83d7-e6612fc4e548 req-7dc3e2d2-8869-4cb3-8580-5503af30bb4e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b0f4422c-d2b0-4c9a-83d7-e6612fc4e548 req-7dc3e2d2-8869-4cb3-8580-5503af30bb4e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-b0f4422c-d2b0-4c9a-83d7-e6612fc4e548 req-7dc3e2d2-8869-4cb3-8580-5503af30bb4e service nova] Creating event network-vif-plugged:048ae78d-29a8-4bc8-9721-6f6286f9872c for instance 064455cd-15c5-4da7-a569-4f1e098e62d4 on user Apr 18 20:15:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-b0f4422c-d2b0-4c9a-83d7-e6612fc4e548 req-7dc3e2d2-8869-4cb3-8580-5503af30bb4e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030253 Apr 18 20:15:41 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 104/297] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c7fba13c-ad1f-4470-a804-f6e4996ca3a6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.231426 Apr 18 20:15:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 97/298] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:15:41 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3/os-interface => generated 283 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-c6d79381-06c3-47d5-9628-af1fbfb1498b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3/ips" status: 200 len: 108 microversion: 2.1 time: 0.040371 Apr 18 20:15:42 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 98/299] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:15:42 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3/ips => generated 108 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:15:43 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-0f6e7f1d-e80e-47f3-b212-9a59564635bd req-fc28b8db-e379-46bd-bc11-7a6d9dbe1fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:43 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-0f6e7f1d-e80e-47f3-b212-9a59564635bd req-fc28b8db-e379-46bd-bc11-7a6d9dbe1fed service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:43 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-0f6e7f1d-e80e-47f3-b212-9a59564635bd req-fc28b8db-e379-46bd-bc11-7a6d9dbe1fed service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:43 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-0f6e7f1d-e80e-47f3-b212-9a59564635bd req-fc28b8db-e379-46bd-bc11-7a6d9dbe1fed service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:43 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-0f6e7f1d-e80e-47f3-b212-9a59564635bd req-fc28b8db-e379-46bd-bc11-7a6d9dbe1fed service nova] Creating event network-changed:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:15:43 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-0f6e7f1d-e80e-47f3-b212-9a59564635bd req-fc28b8db-e379-46bd-bc11-7a6d9dbe1fed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037754 Apr 18 20:15:43 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 105/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:43 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:15:43 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-111e9f2d-56c9-4aa4-9827-ed7132e4b114 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 204 len: 0 microversion: 2.1 time: 0.138148 Apr 18 20:15:43 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 98/301] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:15:43 2023] DELETE /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:44 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:44 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-eacf28fc-2dc3-4372-802f-419d0c2deeb5 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 200 len: 1670 microversion: 2.1 time: 0.269351 Apr 18 20:15:44 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 99/302] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:43 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 1670 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:45 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:45 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "name": "network-vif-unplugged", "status": "completed", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}, {"server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "name": "network-vif-plugged", "status": "completed", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:45 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:45 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] Creating event network-vif-unplugged:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:15:45 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] Creating event network-vif-plugged:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:15:45 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-1a573b1b-2040-4ed7-b80a-6a0a5ee82271 req-8610451d-0907-4945-a369-ce6bbd33c5da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030324 Apr 18 20:15:45 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 106/303] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:45 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:46 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:47 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-763ba7ac-90ec-46cf-a33c-384dbe52d0f4 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 200 len: 1488 microversion: 2.1 time: 0.241927 Apr 18 20:15:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 99/304] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:46 2023] GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 1488 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:47 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-51ca9f09-43d0-4462-8c4b-f1eba794eb59 req-ab94227c-e62f-4d30-867f-c70c488e489f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e30921f-c93e-4d70-9742-4ff289d0dfc3", "name": "network-vif-deleted", "tag": "50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:47 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-51ca9f09-43d0-4462-8c4b-f1eba794eb59 req-ab94227c-e62f-4d30-867f-c70c488e489f service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:47 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-51ca9f09-43d0-4462-8c4b-f1eba794eb59 req-ab94227c-e62f-4d30-867f-c70c488e489f service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:47 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-51ca9f09-43d0-4462-8c4b-f1eba794eb59 req-ab94227c-e62f-4d30-867f-c70c488e489f service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:47 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-51ca9f09-43d0-4462-8c4b-f1eba794eb59 req-ab94227c-e62f-4d30-867f-c70c488e489f service nova] Creating event network-vif-deleted:50e4ed6c-25ac-4ac4-a5ea-0d2a285bf4ea for instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 on user Apr 18 20:15:47 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-51ca9f09-43d0-4462-8c4b-f1eba794eb59 req-ab94227c-e62f-4d30-867f-c70c488e489f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036959 Apr 18 20:15:47 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 100/305] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-214460880", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "c3be6d45-16d3-4a55-bba5-fd501850efde"}]}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] validate_networks() for [('c3be6d45-16d3-4a55-bba5-fd501850efde', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Getting quotas for project b332619e85294fc182a0e341f353d0c3. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Getting quotas for user 79a57c819f0f4dd4a36eadbc002418db and project b332619e85294fc182a0e341f353d0c3. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:15:55 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:15:55 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-51730a30-41f2-41e7-a071-e2523c9b65dd tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.771172 Apr 18 20:15:55 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 107/306] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:15:55 2023] POST /compute/v2.1/servers => generated 378 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:15:55 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9ec50120-b6fc-443f-a90c-0d26c50d2479 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:15:55 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9ec50120-b6fc-443f-a90c-0d26c50d2479 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:15:55 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:55 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-9ec50120-b6fc-443f-a90c-0d26c50d2479 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:15:55 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9ec50120-b6fc-443f-a90c-0d26c50d2479 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1210 microversion: 2.1 time: 0.062411 Apr 18 20:15:55 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 100/307] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:15:55 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1210 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:15:58 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=7 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:58 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=13 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:15:58 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-d057966f-ee0f-4e35-b8dc-bdbdedf5cd6c req-490e69e2-1ff1-4836-a664-0c69095cbf33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "430ea55b-7619-4364-ad4f-0d590c3a5d3e", "tag": "0e32d5d6-4e79-4229-884f-105ee7c1d38d"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:15:58 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d057966f-ee0f-4e35-b8dc-bdbdedf5cd6c req-490e69e2-1ff1-4836-a664-0c69095cbf33 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:15:58 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d057966f-ee0f-4e35-b8dc-bdbdedf5cd6c req-490e69e2-1ff1-4836-a664-0c69095cbf33 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:15:58 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-d057966f-ee0f-4e35-b8dc-bdbdedf5cd6c req-490e69e2-1ff1-4836-a664-0c69095cbf33 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:15:58 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-d057966f-ee0f-4e35-b8dc-bdbdedf5cd6c req-490e69e2-1ff1-4836-a664-0c69095cbf33 service nova] Creating event network-changed:0e32d5d6-4e79-4229-884f-105ee7c1d38d for instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e on user Apr 18 20:15:58 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-d057966f-ee0f-4e35-b8dc-bdbdedf5cd6c req-490e69e2-1ff1-4836-a664-0c69095cbf33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034828 Apr 18 20:15:58 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 101/308] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:15:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:00 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:00 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-38b8eea2-b019-416b-aa34-89c9ab2d2d3e req-d074cd96-1411-4ab4-9a36-78851bd6e7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ea55b-7619-4364-ad4f-0d590c3a5d3e", "name": "network-vif-plugged", "status": "completed", "tag": "0e32d5d6-4e79-4229-884f-105ee7c1d38d"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:00 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-38b8eea2-b019-416b-aa34-89c9ab2d2d3e req-d074cd96-1411-4ab4-9a36-78851bd6e7a8 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:00 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-38b8eea2-b019-416b-aa34-89c9ab2d2d3e req-d074cd96-1411-4ab4-9a36-78851bd6e7a8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:00 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-38b8eea2-b019-416b-aa34-89c9ab2d2d3e req-d074cd96-1411-4ab4-9a36-78851bd6e7a8 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:00 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-38b8eea2-b019-416b-aa34-89c9ab2d2d3e req-d074cd96-1411-4ab4-9a36-78851bd6e7a8 service nova] Creating event network-vif-plugged:0e32d5d6-4e79-4229-884f-105ee7c1d38d for instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e on user Apr 18 20:16:00 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-38b8eea2-b019-416b-aa34-89c9ab2d2d3e req-d074cd96-1411-4ab4-9a36-78851bd6e7a8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.349646 Apr 18 20:16:00 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 108/309] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] [instance: 8cd23717-f912-486a-8a0f-983edcbf5ba2] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] HTTP exception thrown: Instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 could not be found. Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Request method failure captured: Apr 18 20:16:01 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 HTTP/1.1 Apr 18 20:16:01 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:16:01 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:16:01 user devstack@n-api.service[61422]: Connection: close Apr 18 20:16:01 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:16:01 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:16:01 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:16:01 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:16:01 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkor7w5S_kJ5S7QiOfu3DehUQSthnJXG87FFnnTwC7JbJYzYDt3WJ6xeTB9Hxck3iRp4edamk5PYFvgX4nUOR-sd7icOUp0EdC-yn1kZ0V3XgZognz2zBSO75T6pAI5LV_M1SUM_r1Iir9QcR2tKZt5POTbrF2DviN9f1UFYMvhR20 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Project-Id: 6ad73ba40edd4087aff9ae96a69e10c4 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Project-Name: tempest-TestMinimumBasicScenario-1534810194 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ad73ba40edd4087aff9ae96a69e10c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6ad73ba40edd4087aff9ae96a69e10c4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6ad73ba40edd4087aff9ae96a69e10c4"}]}] Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Tenant: tempest-TestMinimumBasicScenario-1534810194 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Tenant-Id: 6ad73ba40edd4087aff9ae96a69e10c4 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1534810194 Apr 18 20:16:01 user devstack@n-api.service[61422]: X-User: tempest-TestMinimumBasicScenario-1534810194-project-member Apr 18 20:16:01 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:16:01 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:16:01 user devstack@n-api.service[61422]: X-User-Id: 48ac512f13754a49bde814ba9e7103ed Apr 18 20:16:01 user devstack@n-api.service[61422]: X-User-Name: tempest-TestMinimumBasicScenario-1534810194-project-member Apr 18 20:16:01 user devstack@n-api.service[61422]: method: > Apr 18 20:16:01 user devstack@n-api.service[61422]: exception: Instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 could not be found. Apr 18 20:16:01 user devstack@n-api.service[61422]: action_args: {'id': '8cd23717-f912-486a-8a0f-983edcbf5ba2'} Apr 18 20:16:01 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 could not be found. Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 could not be found. Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 could not be found. Apr 18 20:16:01 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:16:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Returning 404 to user: Instance 8cd23717-f912-486a-8a0f-983edcbf5ba2 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:16:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-dd56b417-08f7-4b99-96ee-a89886c361ef tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2" status: 404 len: 111 microversion: 2.1 time: 0.384163 Apr 18 20:16:01 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 101/310] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:00 2023] GET /compute/v2.1/servers/8cd23717-f912-486a-8a0f-983edcbf5ba2 => generated 111 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:16:01 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-706736d7-3a0c-454b-af33-88ec637289cf tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] Calling method '.version_select at 0x7fb773ab2b00>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:01 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-706736d7-3a0c-454b-af33-88ec637289cf tempest-TestMinimumBasicScenario-1534810194 tempest-TestMinimumBasicScenario-1534810194-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1260195738" status: 202 len: 0 microversion: 2.1 time: 0.023026 Apr 18 20:16:01 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 102/311] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 20:16:01 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1260195738 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:16:03 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-4c75065d-4182-4628-9816-aa6512f816ed req-995c4799-c94e-46cf-a4ee-f5813c5ce15d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ea55b-7619-4364-ad4f-0d590c3a5d3e", "name": "network-vif-plugged", "status": "completed", "tag": "0e32d5d6-4e79-4229-884f-105ee7c1d38d"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:03 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-4c75065d-4182-4628-9816-aa6512f816ed req-995c4799-c94e-46cf-a4ee-f5813c5ce15d service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:03 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-4c75065d-4182-4628-9816-aa6512f816ed req-995c4799-c94e-46cf-a4ee-f5813c5ce15d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:03 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-4c75065d-4182-4628-9816-aa6512f816ed req-995c4799-c94e-46cf-a4ee-f5813c5ce15d service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:03 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-4c75065d-4182-4628-9816-aa6512f816ed req-995c4799-c94e-46cf-a4ee-f5813c5ce15d service nova] Creating event network-vif-plugged:0e32d5d6-4e79-4229-884f-105ee7c1d38d for instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e on user Apr 18 20:16:03 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-4c75065d-4182-4628-9816-aa6512f816ed req-995c4799-c94e-46cf-a4ee-f5813c5ce15d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043442 Apr 18 20:16:03 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 109/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=5 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:24 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e891b948918d4beca7a9215d8e536a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12026d2f47254305a57bde39cbb038f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:24 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ed4bf4c6-c48a-42c6-9f45-0d7c5558b542 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4" status: 200 len: 1483 microversion: 2.1 time: 0.217034 Apr 18 20:16:24 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 102/313] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:24 2023] GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4 => generated 1483 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:25 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-456d20ba-54ca-4a64-b5a1-bac4f0fabda0 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.213254 Apr 18 20:16:25 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 103/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:24 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=16,nova_api:INSERT=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-546392096", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "bced5834-bb13-4a51-9ae0-beca997a2850", "destination_type": "volume"}], "networks": [{"uuid": "5b16deaf-2b61-4095-91ec-8e78f9af18fe"}]}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] validate_networks() for [('5b16deaf-2b61-4095-91ec-8e78f9af18fe', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Getting quotas for user 4918574af24b49d1b355bd3970ef6be4 and project f51729e3d9f3464789aa11df3369e717. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:16:31 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:16:31 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-6d944dfe-74a1-482f-a4f1-3c4630b641d9 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.569047 Apr 18 20:16:31 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 110/315] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:16:31 2023] POST /compute/v2.1/servers => generated 378 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 20:16:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-ec21d7fa-b334-478b-b946-4ae86995c26a tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-ec21d7fa-b334-478b-b946-4ae86995c26a tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:31 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ec21d7fa-b334-478b-b946-4ae86995c26a tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:31 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ec21d7fa-b334-478b-b946-4ae86995c26a tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:31 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-ec21d7fa-b334-478b-b946-4ae86995c26a tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-ec21d7fa-b334-478b-b946-4ae86995c26a tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd" status: 200 len: 1394 microversion: 2.87 time: 0.064434 Apr 18 20:16:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 103/316] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:16:31 2023] GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd => generated 1394 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:16:34 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-8b5b9293-e84a-4f9d-a48a-2c8489180d70 req-6ee9cdc3-29bd-4cb6-b139-d6fc1a7d2343 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "546d3df9-b78a-4640-a926-b325058dfdfd", "tag": "9874c2c9-5ef9-45b1-a6f9-0edfbf9e16c6"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:34 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8b5b9293-e84a-4f9d-a48a-2c8489180d70 req-6ee9cdc3-29bd-4cb6-b139-d6fc1a7d2343 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:34 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8b5b9293-e84a-4f9d-a48a-2c8489180d70 req-6ee9cdc3-29bd-4cb6-b139-d6fc1a7d2343 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:34 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8b5b9293-e84a-4f9d-a48a-2c8489180d70 req-6ee9cdc3-29bd-4cb6-b139-d6fc1a7d2343 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-8b5b9293-e84a-4f9d-a48a-2c8489180d70 req-6ee9cdc3-29bd-4cb6-b139-d6fc1a7d2343 service nova] Creating event network-changed:9874c2c9-5ef9-45b1-a6f9-0edfbf9e16c6 for instance 546d3df9-b78a-4640-a926-b325058dfdfd on user Apr 18 20:16:34 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-8b5b9293-e84a-4f9d-a48a-2c8489180d70 req-6ee9cdc3-29bd-4cb6-b139-d6fc1a7d2343 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027709 Apr 18 20:16:34 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 104/317] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:34 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:16:34 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 HTTP/1.1 Apr 18 20:16:34 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:16:34 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:16:34 user devstack@n-api.service[61420]: Connection: close Apr 18 20:16:34 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:16:34 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:16:34 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:16:34 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:16:34 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:16:34 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:16:34 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:16:34 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:16:34 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:16:34 user devstack@n-api.service[61420]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:16:34 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:16:34 user devstack@n-api.service[61420]: method: > Apr 18 20:16:34 user devstack@n-api.service[61420]: exception: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:16:34 user devstack@n-api.service[61420]: action_args: {'id': '2e30921f-c93e-4d70-9742-4ff289d0dfc3'} Apr 18 20:16:34 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:16:34 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:16:34 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:16:34 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-5ce52048-5d78-4623-acad-97e4713cdbcf tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 404 len: 111 microversion: 2.1 time: 0.029384 Apr 18 20:16:34 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 111/318] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:34 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:16:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1b2c0b16-4d09-4d90-aa76-307aadf91818 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '.version_select at 0x7fb7738dd360>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-1b2c0b16-4d09-4d90-aa76-307aadf91818 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-602955330" status: 202 len: 0 microversion: 2.1 time: 0.028300 Apr 18 20:16:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 104/319] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 20:16:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-602955330 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:16:34 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-966e8799-5776-4dea-8be0-1ad781775c49 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Action: 'create', calling method: .version_select at 0x7fb773ab17e0>, body: {"keypair": {"name": "tempest-keypair-2054033936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKE2fyeA5Jpf+ShCiGQbCaO3NS7bEAScXu4QEs2PX5ZnXzRfgbPNsxdvuPWQIPjLfvFGm+XlNFSIPUmmF6TEYiXjv07E6MfK7Gj6XkY8Ds/QlUE6oK95SrmIFH4bE9YdiQ=="}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:35 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-966e8799-5776-4dea-8be0-1ad781775c49 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:16:35 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-966e8799-5776-4dea-8be0-1ad781775c49 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for user 4859711fcdef4d91ae9caff4bacc85fe and project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:16:35 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-966e8799-5776-4dea-8be0-1ad781775c49 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044296 Apr 18 20:16:35 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 105/320] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:16:34 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:16:36 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-846567384", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ef116b62-6faf-4010-a37c-960d9a4b6b02"}], "security_groups": [{"name": "tempest-securitygroup--1777353803"}], "key_name": "tempest-keypair-2054033936", "user_data": "}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:36 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] validate_networks() for [('ef116b62-6faf-4010-a37c-960d9a4b6b02', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for user 4859711fcdef4d91ae9caff4bacc85fe and project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:16:37 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:16:37 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-410b34f1-3954-404d-90d2-b487104e358d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.598845 Apr 18 20:16:37 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 112/321] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:16:36 2023] POST /compute/v2.1/servers => generated 400 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:16:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-00a01139-cb65-4eee-9bb3-f5a3066861f3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-00a01139-cb65-4eee-9bb3-f5a3066861f3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:37 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-00a01139-cb65-4eee-9bb3-f5a3066861f3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:37 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-00a01139-cb65-4eee-9bb3-f5a3066861f3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 200 len: 1235 microversion: 2.1 time: 0.058987 Apr 18 20:16:37 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 105/322] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:37 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 1235 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:16:39 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-2eb3b218-e2a2-41d5-82ed-ebee9fe115fd req-c7f953fc-b4d9-49c5-ac91-6fe4aadeafe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "546d3df9-b78a-4640-a926-b325058dfdfd", "name": "network-vif-deleted", "tag": "9874c2c9-5ef9-45b1-a6f9-0edfbf9e16c6"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2eb3b218-e2a2-41d5-82ed-ebee9fe115fd req-c7f953fc-b4d9-49c5-ac91-6fe4aadeafe1 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2eb3b218-e2a2-41d5-82ed-ebee9fe115fd req-c7f953fc-b4d9-49c5-ac91-6fe4aadeafe1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:39 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-2eb3b218-e2a2-41d5-82ed-ebee9fe115fd req-c7f953fc-b4d9-49c5-ac91-6fe4aadeafe1 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:39 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.compute.server_external_events [req-2eb3b218-e2a2-41d5-82ed-ebee9fe115fd req-c7f953fc-b4d9-49c5-ac91-6fe4aadeafe1 service nova] Unable to find a host for instance 546d3df9-b78a-4640-a926-b325058dfdfd. Dropping event network-vif-deleted {{(pid=61421) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 20:16:39 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-2eb3b218-e2a2-41d5-82ed-ebee9fe115fd req-c7f953fc-b4d9-49c5-ac91-6fe4aadeafe1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.025505 Apr 18 20:16:39 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 106/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 20:16:39 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-dddcca16-2867-4912-9a99-f654f9330fa4 req-b26b5688-7861-495b-ac85-f299df6ba463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dddcca16-2867-4912-9a99-f654f9330fa4 req-b26b5688-7861-495b-ac85-f299df6ba463 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dddcca16-2867-4912-9a99-f654f9330fa4 req-b26b5688-7861-495b-ac85-f299df6ba463 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dddcca16-2867-4912-9a99-f654f9330fa4 req-b26b5688-7861-495b-ac85-f299df6ba463 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-dddcca16-2867-4912-9a99-f654f9330fa4 req-b26b5688-7861-495b-ac85-f299df6ba463 service nova] Creating event network-changed:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:16:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-dddcca16-2867-4912-9a99-f654f9330fa4 req-b26b5688-7861-495b-ac85-f299df6ba463 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027668 Apr 18 20:16:39 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 113/324] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-18135980-e14c-4ef7-94b4-108fe6284dab req-b8c1d262-c5a1-4991-824c-4cdb2bf1f4a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "name": "network-vif-plugged", "status": "completed", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-18135980-e14c-4ef7-94b4-108fe6284dab req-b8c1d262-c5a1-4991-824c-4cdb2bf1f4a0 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-18135980-e14c-4ef7-94b4-108fe6284dab req-b8c1d262-c5a1-4991-824c-4cdb2bf1f4a0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-18135980-e14c-4ef7-94b4-108fe6284dab req-b8c1d262-c5a1-4991-824c-4cdb2bf1f4a0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-18135980-e14c-4ef7-94b4-108fe6284dab req-b8c1d262-c5a1-4991-824c-4cdb2bf1f4a0 service nova] Creating event network-vif-plugged:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:16:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-18135980-e14c-4ef7-94b4-108fe6284dab req-b8c1d262-c5a1-4991-824c-4cdb2bf1f4a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032365 Apr 18 20:16:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 106/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:43 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-713c4dff-2c85-4604-be26-2a6594c359e8 req-84f6a439-32b2-4476-8dbe-78561c4d5c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "name": "network-vif-plugged", "status": "completed", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:16:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-713c4dff-2c85-4604-be26-2a6594c359e8 req-84f6a439-32b2-4476-8dbe-78561c4d5c26 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-713c4dff-2c85-4604-be26-2a6594c359e8 req-84f6a439-32b2-4476-8dbe-78561c4d5c26 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-713c4dff-2c85-4604-be26-2a6594c359e8 req-84f6a439-32b2-4476-8dbe-78561c4d5c26 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:43 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-713c4dff-2c85-4604-be26-2a6594c359e8 req-84f6a439-32b2-4476-8dbe-78561c4d5c26 service nova] Creating event network-vif-plugged:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:16:43 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-713c4dff-2c85-4604-be26-2a6594c359e8 req-84f6a439-32b2-4476-8dbe-78561c4d5c26 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032031 Apr 18 20:16:43 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 107/326] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:16:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:46 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:46 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-af7c1dea-84b3-4d9e-a64f-d709681d3b6b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1493 microversion: 2.1 time: 0.230144 Apr 18 20:16:46 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 114/327] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:46 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1493 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:16:47 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:16:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-659aec91-149c-420b-a836-8c422f178fc9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea" status: 200 len: 1502 microversion: 2.1 time: 0.231798 Apr 18 20:16:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 107/328] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:16:47 2023] GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=12 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG nova.objects.instance [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lazy-loading 'fault' on Instance uuid 546d3df9-b78a-4640-a926-b325058dfdfd {{(pid=61421) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:21 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:21 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-13a14370-98c9-43a8-be09-59e91a7427f6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd" status: 200 len: 1649 microversion: 2.87 time: 0.109493 Apr 18 20:17:21 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 108/329] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:17:21 2023] GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd => generated 1649 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=12 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=14 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:21 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Doing local delete in cell 285bd6ea-7144-4ccd-a44d-fb1de459fade(cell1) {{(pid=61420) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:22 user devstack@n-api.service[61420]: WARNING nova.compute.api [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] instance's host None is down, deleting from database Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] deallocate_for_instance() {{(pid=61420) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Instance cache missing network info. {{(pid=61420) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Updating instance_info_cache with network_info: [] {{(pid=61420) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 20:17:22 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61420) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 20:17:22 user devstack@n-api.service[61420]: WARNING nova.compute.api [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 20:17:22 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-13204797-9ac7-4031-a6cc-4cc03bfe536d tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd" status: 204 len: 0 microversion: 2.87 time: 0.719932 Apr 18 20:17:22 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 115/330] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:17:21 2023] DELETE /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 546d3df9-b78a-4640-a926-b325058dfdfd] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=8 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] HTTP exception thrown: Instance 546d3df9-b78a-4640-a926-b325058dfdfd could not be found. Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Request method failure captured: Apr 18 20:17:22 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd HTTP/1.1 Apr 18 20:17:22 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:17:22 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:17:22 user devstack@n-api.service[61422]: Connection: close Apr 18 20:17:22 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:17:22 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:17:22 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:17:22 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:17:22 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkEp9tBh9JgSefVTQbPbckzU2zbiAF2TonKcmCIymhDNgqAw9wQgxR2ZNGQsLA6vkEmyHynGzW543TY8xcpIxpgBf9r9AIjEWNtX2mgtTCR6kCYQ3nfv82A0ipYjLT3a-qyXZdEbRXRk6tYvRHAQCOql8E3SoH35JyupAtxKP1DcXM Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Project-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51729e3d9f3464789aa11df3369e717"}]}] Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Tenant-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:17:22 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:17:22 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:17:22 user devstack@n-api.service[61422]: X-User-Id: 4918574af24b49d1b355bd3970ef6be4 Apr 18 20:17:22 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:17:22 user devstack@n-api.service[61422]: method: > Apr 18 20:17:22 user devstack@n-api.service[61422]: exception: Instance 546d3df9-b78a-4640-a926-b325058dfdfd could not be found. Apr 18 20:17:22 user devstack@n-api.service[61422]: action_args: {'id': '546d3df9-b78a-4640-a926-b325058dfdfd'} Apr 18 20:17:22 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 546d3df9-b78a-4640-a926-b325058dfdfd could not be found. Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 546d3df9-b78a-4640-a926-b325058dfdfd could not be found. Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 546d3df9-b78a-4640-a926-b325058dfdfd could not be found. Apr 18 20:17:22 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:17:22 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Returning 404 to user: Instance 546d3df9-b78a-4640-a926-b325058dfdfd could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:17:22 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-66cd9d3a-1c89-40e0-895d-ab4015c5cad6 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd" status: 404 len: 111 microversion: 2.87 time: 0.065995 Apr 18 20:17:22 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 108/331] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:17:22 2023] GET /compute/v2.1/servers/546d3df9-b78a-4640-a926-b325058dfdfd => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:23 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:17:23 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-66d55ed4-7529-462b-b26b-a28885143a54 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8" status: 204 len: 0 microversion: 2.87 time: 0.112738 Apr 18 20:17:23 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 109/332] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:17:23 2023] DELETE /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:23 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:23 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-f2a691f3-934d-4dbf-8027-9f05b64cb7a7 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8" status: 200 len: 1697 microversion: 2.87 time: 0.262638 Apr 18 20:17:23 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 116/333] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:17:23 2023] GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 => generated 1697 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:17:23 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-f450838c-aa15-4f5a-9a3d-632817db5beb req-a1869a30-961b-4af4-9c9d-a05a66592fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-unplugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f450838c-aa15-4f5a-9a3d-632817db5beb req-a1869a30-961b-4af4-9c9d-a05a66592fb0 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f450838c-aa15-4f5a-9a3d-632817db5beb req-a1869a30-961b-4af4-9c9d-a05a66592fb0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:23 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-f450838c-aa15-4f5a-9a3d-632817db5beb req-a1869a30-961b-4af4-9c9d-a05a66592fb0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-f450838c-aa15-4f5a-9a3d-632817db5beb req-a1869a30-961b-4af4-9c9d-a05a66592fb0 service nova] Creating event network-vif-unplugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:17:23 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-f450838c-aa15-4f5a-9a3d-632817db5beb req-a1869a30-961b-4af4-9c9d-a05a66592fb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153639 Apr 18 20:17:23 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 109/334] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:17:24 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-b14f72a7-799e-4c72-a7b1-55caa1cc22fa req-e126a14e-6640-4a0a-b6a7-9e305a4d6ff5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-deleted", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b14f72a7-799e-4c72-a7b1-55caa1cc22fa req-e126a14e-6640-4a0a-b6a7-9e305a4d6ff5 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b14f72a7-799e-4c72-a7b1-55caa1cc22fa req-e126a14e-6640-4a0a-b6a7-9e305a4d6ff5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:24 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b14f72a7-799e-4c72-a7b1-55caa1cc22fa req-e126a14e-6640-4a0a-b6a7-9e305a4d6ff5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:24 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-b14f72a7-799e-4c72-a7b1-55caa1cc22fa req-e126a14e-6640-4a0a-b6a7-9e305a4d6ff5 service nova] Creating event network-vif-deleted:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:17:24 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-b14f72a7-799e-4c72-a7b1-55caa1cc22fa req-e126a14e-6640-4a0a-b6a7-9e305a4d6ff5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029444 Apr 18 20:17:24 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 110/335] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4c0e1106-558f-495a-baf4-b4c96a1189ef tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.231077 Apr 18 20:17:25 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 117/336] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:25 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}, {"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}, {"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}, {"server_uuid": "08c50866-e4e7-461b-830b-f221305d7ac8", "name": "network-vif-plugged", "status": "completed", "tag": "3f910da1-954f-465d-8f0f-d5c82e601352"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:25 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-50968b75-a55e-4e9e-9651-8cbc50d9e488 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.152338 Apr 18 20:17:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 110/337] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:25 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Creating event network-vif-plugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Creating event network-vif-plugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Creating event network-vif-plugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:17:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] Creating event network-vif-plugged:3f910da1-954f-465d-8f0f-d5c82e601352 for instance 08c50866-e4e7-461b-830b-f221305d7ac8 on user Apr 18 20:17:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-56d61d1d-4158-4dc7-abab-8577a2f94e05 req-95e7180f-a3f5-49c0-9060-5d91f8a60325 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054358 Apr 18 20:17:25 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 111/338] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:25 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:17:25 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:25 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-32fc2c80-4a57-49ef-9ed6-c5dcc6344f7e tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.133743 Apr 18 20:17:25 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 118/339] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:25 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:26 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:17:26 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-76889ba1-4738-435f-92e2-5e65c96f52b4 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4" status: 204 len: 0 microversion: 2.1 time: 0.126345 Apr 18 20:17:26 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 111/340] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:17:26 2023] DELETE /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:26 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e891b948918d4beca7a9215d8e536a3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12026d2f47254305a57bde39cbb038f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:26 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-3ddb0a8d-6ac6-4ccf-8cb4-2669e8e3ab87 tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4" status: 200 len: 1489 microversion: 2.1 time: 0.365350 Apr 18 20:17:26 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 112/341] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:26 2023] GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4 => generated 1489 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:26 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-24b6cb6b-73f0-4587-b6e3-89bdf288100f req-ee892c92-4400-485d-873e-5065afaed0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064455cd-15c5-4da7-a569-4f1e098e62d4", "name": "network-vif-unplugged", "status": "completed", "tag": "048ae78d-29a8-4bc8-9721-6f6286f9872c"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:26 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-24b6cb6b-73f0-4587-b6e3-89bdf288100f req-ee892c92-4400-485d-873e-5065afaed0cf service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:26 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-24b6cb6b-73f0-4587-b6e3-89bdf288100f req-ee892c92-4400-485d-873e-5065afaed0cf service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:26 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-24b6cb6b-73f0-4587-b6e3-89bdf288100f req-ee892c92-4400-485d-873e-5065afaed0cf service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:26 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-24b6cb6b-73f0-4587-b6e3-89bdf288100f req-ee892c92-4400-485d-873e-5065afaed0cf service nova] Creating event network-vif-unplugged:048ae78d-29a8-4bc8-9721-6f6286f9872c for instance 064455cd-15c5-4da7-a569-4f1e098e62d4 on user Apr 18 20:17:26 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-24b6cb6b-73f0-4587-b6e3-89bdf288100f req-ee892c92-4400-485d-873e-5065afaed0cf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031115 Apr 18 20:17:26 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 119/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:27 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:28 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-db9b1c8d-8e67-406f-bdd7-d5838e7d4ef3 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 200 len: 1545 microversion: 2.1 time: 0.761232 Apr 18 20:17:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 112/343] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:27 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 1545 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "064455cd-15c5-4da7-a569-4f1e098e62d4", "name": "network-vif-plugged", "status": "completed", "tag": "048ae78d-29a8-4bc8-9721-6f6286f9872c"}, {"server_uuid": "064455cd-15c5-4da7-a569-4f1e098e62d4", "name": "network-vif-deleted", "tag": "048ae78d-29a8-4bc8-9721-6f6286f9872c"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] Creating event network-vif-plugged:048ae78d-29a8-4bc8-9721-6f6286f9872c for instance 064455cd-15c5-4da7-a569-4f1e098e62d4 on user Apr 18 20:17:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] Creating event network-vif-deleted:048ae78d-29a8-4bc8-9721-6f6286f9872c for instance 064455cd-15c5-4da7-a569-4f1e098e62d4 on user Apr 18 20:17:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-3449cc6c-6a54-4a56-a97e-5e97035f49da req-13ebb521-4ad9-49b2-b754-bec2d511edcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036209 Apr 18 20:17:28 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 113/344] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:28 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1313234492", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "networks": [{"uuid": "c3be6d45-16d3-4a55-bba5-fd501850efde"}]}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] validate_networks() for [('c3be6d45-16d3-4a55-bba5-fd501850efde', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Getting quotas for project b332619e85294fc182a0e341f353d0c3. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Getting quotas for user 79a57c819f0f4dd4a36eadbc002418db and project b332619e85294fc182a0e341f353d0c3. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:17:46 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:17:46 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-894b4837-3506-4ec7-828d-a6f0b7fe46f6 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.580839 Apr 18 20:17:46 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 120/345] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:17:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:17:46 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-2445b019-9512-4c9f-8b26-80d39515e44b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:46 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-2445b019-9512-4c9f-8b26-80d39515e44b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:46 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:46 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:47 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-2445b019-9512-4c9f-8b26-80d39515e44b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-2445b019-9512-4c9f-8b26-80d39515e44b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 200 len: 1211 microversion: 2.1 time: 0.069932 Apr 18 20:17:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 113/346] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:46 2023] GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 1211 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:17:49 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-92bb7d31-5068-47ee-8ff7-e69199c29349 req-3802c830-0c15-453c-af4e-c7203cbca826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db39cb17-b71e-4aef-a854-cd1da1f9ab05", "tag": "22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-92bb7d31-5068-47ee-8ff7-e69199c29349 req-3802c830-0c15-453c-af4e-c7203cbca826 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-92bb7d31-5068-47ee-8ff7-e69199c29349 req-3802c830-0c15-453c-af4e-c7203cbca826 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-92bb7d31-5068-47ee-8ff7-e69199c29349 req-3802c830-0c15-453c-af4e-c7203cbca826 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:49 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-92bb7d31-5068-47ee-8ff7-e69199c29349 req-3802c830-0c15-453c-af4e-c7203cbca826 service nova] Creating event network-changed:22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a for instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 on user Apr 18 20:17:49 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-92bb7d31-5068-47ee-8ff7-e69199c29349 req-3802c830-0c15-453c-af4e-c7203cbca826 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032825 Apr 18 20:17:49 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 114/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:50 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:17:50 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-16996df3-548e-46ea-b91a-79c53c2add9d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 204 len: 0 microversion: 2.1 time: 0.104243 Apr 18 20:17:50 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 121/348] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:17:50 2023] DELETE /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:50 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:17:50 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-9b58187c-9abd-4d2b-ada4-816a3fc50db9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 200 len: 1494 microversion: 2.1 time: 0.354583 Apr 18 20:17:50 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 114/349] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:17:50 2023] GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 1494 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:17:51 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-unplugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:51 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:51 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:51 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Creating event network-vif-unplugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:51 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-299b6adc-bce2-4550-bc57-6d33ab4cbcfd req-59308706-56e3-418c-9839-31321729951a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.039597 Apr 18 20:17:51 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 115/350] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:17:53 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-unplugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-plugged", "status": "completed", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "6c0a5bc6-4536-4952-a5bd-990622ad400e", "name": "network-vif-deleted", "tag": "c013f732-4432-48cc-ab31-79d74925fd8c"}, {"server_uuid": "db39cb17-b71e-4aef-a854-cd1da1f9ab05", "name": "network-vif-plugged", "status": "completed", "tag": "22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a"}, {"server_uuid": "db39cb17-b71e-4aef-a854-cd1da1f9ab05", "name": "network-vif-plugged", "status": "completed", "tag": "22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:17:53 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:17:53 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:17:53 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Creating event network-vif-unplugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Creating event network-vif-plugged:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Creating event network-vif-deleted:c013f732-4432-48cc-ab31-79d74925fd8c for instance 6c0a5bc6-4536-4952-a5bd-990622ad400e on user Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Creating event network-vif-plugged:22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a for instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 on user Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] Creating event network-vif-plugged:22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a for instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 on user Apr 18 20:17:53 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-6bd20799-3bd6-49f2-8e22-14b42e241dad req-1b20b969-5240-4e16-a2a1-b6f7d4df96e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.034245 Apr 18 20:17:53 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 122/351] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 08c50866-e4e7-461b-830b-f221305d7ac8] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] HTTP exception thrown: Instance 08c50866-e4e7-461b-830b-f221305d7ac8 could not be found. Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Request method failure captured: Apr 18 20:18:13 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 HTTP/1.1 Apr 18 20:18:13 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:18:13 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:18:13 user devstack@n-api.service[61422]: Connection: close Apr 18 20:18:13 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:18:13 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:18:13 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:18:13 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:18:13 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvkEp9tBh9JgSefVTQbPbckzU2zbiAF2TonKcmCIymhDNgqAw9wQgxR2ZNGQsLA6vkEmyHynGzW543TY8xcpIxpgBf9r9AIjEWNtX2mgtTCR6kCYQ3nfv82A0ipYjLT3a-qyXZdEbRXRk6tYvRHAQCOql8E3SoH35JyupAtxKP1DcXM Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Project-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51729e3d9f3464789aa11df3369e717"}]}] Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Tenant-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:18:13 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:18:13 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:18:13 user devstack@n-api.service[61422]: X-User-Id: 4918574af24b49d1b355bd3970ef6be4 Apr 18 20:18:13 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:18:13 user devstack@n-api.service[61422]: method: > Apr 18 20:18:13 user devstack@n-api.service[61422]: exception: Instance 08c50866-e4e7-461b-830b-f221305d7ac8 could not be found. Apr 18 20:18:13 user devstack@n-api.service[61422]: action_args: {'id': '08c50866-e4e7-461b-830b-f221305d7ac8'} Apr 18 20:18:13 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c50866-e4e7-461b-830b-f221305d7ac8 could not be found. Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c50866-e4e7-461b-830b-f221305d7ac8 could not be found. Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c50866-e4e7-461b-830b-f221305d7ac8 could not be found. Apr 18 20:18:13 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Returning 404 to user: Instance 08c50866-e4e7-461b-830b-f221305d7ac8 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:18:13 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c3cb9263-716a-4710-b1a2-06974fbe6e90 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8" status: 404 len: 111 microversion: 2.87 time: 0.033174 Apr 18 20:18:13 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 115/352] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:18:13 2023] GET /compute/v2.1/servers/08c50866-e4e7-461b-830b-f221305d7ac8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:13 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:18:13 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-ea0f84e0-0868-42c7-97e3-47dc269c4413 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b" status: 204 len: 0 microversion: 2.87 time: 0.112798 Apr 18 20:18:13 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 116/353] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:18:13 2023] DELETE /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:13 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-14ba8785-3973-4f51-9d7a-aeab68d88421 req-57a452ff-2276-4421-aec9-9bdc45cf0a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349b3f34-40ef-416e-a077-7cc112925c2b", "name": "network-vif-unplugged", "status": "completed", "tag": "7dbb2500-fd31-400b-8ce1-bf1230143a6a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:13 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-14ba8785-3973-4f51-9d7a-aeab68d88421 req-57a452ff-2276-4421-aec9-9bdc45cf0a6f service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-14ba8785-3973-4f51-9d7a-aeab68d88421 req-57a452ff-2276-4421-aec9-9bdc45cf0a6f service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:14 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-14ba8785-3973-4f51-9d7a-aeab68d88421 req-57a452ff-2276-4421-aec9-9bdc45cf0a6f service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-14ba8785-3973-4f51-9d7a-aeab68d88421 req-57a452ff-2276-4421-aec9-9bdc45cf0a6f service nova] Creating event network-vif-unplugged:7dbb2500-fd31-400b-8ce1-bf1230143a6a for instance 349b3f34-40ef-416e-a077-7cc112925c2b on user Apr 18 20:18:14 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-14ba8785-3973-4f51-9d7a-aeab68d88421 req-57a452ff-2276-4421-aec9-9bdc45cf0a6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035706 Apr 18 20:18:14 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:14 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:14 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:14 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4918574af24b49d1b355bd3970ef6be4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f51729e3d9f3464789aa11df3369e717', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:14 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-86789ba3-7683-40a0-8621-63ab8f4a4a68 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b" status: 200 len: 1698 microversion: 2.87 time: 0.314566 Apr 18 20:18:14 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 123/355] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:18:13 2023] GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b => generated 1698 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:18:14 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-9a7162e4-d2ff-448c-bae8-a1ac6b4fcc16 req-f31fb03f-65ec-4dc6-af77-37131baabe9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349b3f34-40ef-416e-a077-7cc112925c2b", "name": "network-vif-deleted", "tag": "7dbb2500-fd31-400b-8ce1-bf1230143a6a"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-9a7162e4-d2ff-448c-bae8-a1ac6b4fcc16 req-f31fb03f-65ec-4dc6-af77-37131baabe9c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-9a7162e4-d2ff-448c-bae8-a1ac6b4fcc16 req-f31fb03f-65ec-4dc6-af77-37131baabe9c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:14 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-9a7162e4-d2ff-448c-bae8-a1ac6b4fcc16 req-f31fb03f-65ec-4dc6-af77-37131baabe9c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:14 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-9a7162e4-d2ff-448c-bae8-a1ac6b4fcc16 req-f31fb03f-65ec-4dc6-af77-37131baabe9c service nova] Creating event network-vif-deleted:7dbb2500-fd31-400b-8ce1-bf1230143a6a for instance 349b3f34-40ef-416e-a077-7cc112925c2b on user Apr 18 20:18:14 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-9a7162e4-d2ff-448c-bae8-a1ac6b4fcc16 req-f31fb03f-65ec-4dc6-af77-37131baabe9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035262 Apr 18 20:18:14 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 117/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-d0fe848f-77b3-483d-b00a-831fd111fced req-266a84db-5801-4923-aac8-96071f21a35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349b3f34-40ef-416e-a077-7cc112925c2b", "name": "network-vif-plugged", "status": "completed", "tag": "7dbb2500-fd31-400b-8ce1-bf1230143a6a"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d0fe848f-77b3-483d-b00a-831fd111fced req-266a84db-5801-4923-aac8-96071f21a35b service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d0fe848f-77b3-483d-b00a-831fd111fced req-266a84db-5801-4923-aac8-96071f21a35b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-d0fe848f-77b3-483d-b00a-831fd111fced req-266a84db-5801-4923-aac8-96071f21a35b service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-d0fe848f-77b3-483d-b00a-831fd111fced req-266a84db-5801-4923-aac8-96071f21a35b service nova] Creating event network-vif-plugged:7dbb2500-fd31-400b-8ce1-bf1230143a6a for instance 349b3f34-40ef-416e-a077-7cc112925c2b on user Apr 18 20:18:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-d0fe848f-77b3-483d-b00a-831fd111fced req-266a84db-5801-4923-aac8-96071f21a35b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028395 Apr 18 20:18:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 117/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] [instance: 064455cd-15c5-4da7-a569-4f1e098e62d4] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:16 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] HTTP exception thrown: Instance 064455cd-15c5-4da7-a569-4f1e098e62d4 could not be found. Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Request method failure captured: Apr 18 20:18:16 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4 HTTP/1.1 Apr 18 20:18:16 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:18:16 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:18:16 user devstack@n-api.service[61420]: Connection: close Apr 18 20:18:16 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:18:16 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:18:16 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:18:16 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:18:16 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvpj0lV9hGk0uHhfmhsF3mOCNCUCZAQ4h9YuUKal5DF2DVc_h0Rk8kBYpp2aYszuwd4fU8bxJJ9uIyQu_VUNT0jZEAaZcEUV_xmzpNXTH0jDF9zzEqTAy_-aPWpKKg7u4U30cXw4Vt5P0eRHJuVkz-JJAzU-Mt3XGLNccwf-oaNebos Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Project-Id: 12026d2f47254305a57bde39cbb038f8 Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Project-Name: tempest-VolumesActionsTest-2070783484 Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12026d2f47254305a57bde39cbb038f8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/12026d2f47254305a57bde39cbb038f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/12026d2f47254305a57bde39cbb038f8"}]}] Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Tenant: tempest-VolumesActionsTest-2070783484 Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Tenant-Id: 12026d2f47254305a57bde39cbb038f8 Apr 18 20:18:16 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-VolumesActionsTest-2070783484 Apr 18 20:18:16 user devstack@n-api.service[61420]: X-User: tempest-VolumesActionsTest-2070783484-project-member Apr 18 20:18:16 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:18:16 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:18:16 user devstack@n-api.service[61420]: X-User-Id: e891b948918d4beca7a9215d8e536a3a Apr 18 20:18:16 user devstack@n-api.service[61420]: X-User-Name: tempest-VolumesActionsTest-2070783484-project-member Apr 18 20:18:16 user devstack@n-api.service[61420]: method: > Apr 18 20:18:16 user devstack@n-api.service[61420]: exception: Instance 064455cd-15c5-4da7-a569-4f1e098e62d4 could not be found. Apr 18 20:18:16 user devstack@n-api.service[61420]: action_args: {'id': '064455cd-15c5-4da7-a569-4f1e098e62d4'} Apr 18 20:18:16 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 064455cd-15c5-4da7-a569-4f1e098e62d4 could not be found. Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 064455cd-15c5-4da7-a569-4f1e098e62d4 could not be found. Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 064455cd-15c5-4da7-a569-4f1e098e62d4 could not be found. Apr 18 20:18:16 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:18:16 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] Returning 404 to user: Instance 064455cd-15c5-4da7-a569-4f1e098e62d4 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:18:16 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-a8e10d4b-649c-47c2-9d64-8c33767c813f tempest-VolumesActionsTest-2070783484 tempest-VolumesActionsTest-2070783484-project-member] 10.0.0.210 "GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4" status: 404 len: 111 microversion: 2.1 time: 0.030780 Apr 18 20:18:16 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 124/358] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:18:16 2023] GET /compute/v2.1/servers/064455cd-15c5-4da7-a569-4f1e098e62d4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:27 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:27 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-0e15b7e1-01a3-4ab0-9a90-76662a0296dc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1657 microversion: 2.1 time: 0.241970 Apr 18 20:18:27 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 118/359] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:18:27 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1657 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e25e19f4-e0ac-484e-8f07-223c45fdaf9d tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.168237 Apr 18 20:18:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 118/360] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:18:28 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0/os-interface => generated 283 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:29 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-43f1151d-990c-4b31-b51f-387862daf337 req-b2e8ff87-7e08-4c6b-a267-5da7c1123730 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:29 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:29 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=8 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:18:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-43f1151d-990c-4b31-b51f-387862daf337 req-b2e8ff87-7e08-4c6b-a267-5da7c1123730 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-43f1151d-990c-4b31-b51f-387862daf337 req-b2e8ff87-7e08-4c6b-a267-5da7c1123730 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:29 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-43f1151d-990c-4b31-b51f-387862daf337 req-b2e8ff87-7e08-4c6b-a267-5da7c1123730 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:29 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-43f1151d-990c-4b31-b51f-387862daf337 req-b2e8ff87-7e08-4c6b-a267-5da7c1123730 service nova] Creating event network-changed:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:18:29 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-43f1151d-990c-4b31-b51f-387862daf337 req-b2e8ff87-7e08-4c6b-a267-5da7c1123730 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034045 Apr 18 20:18:29 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 125/361] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:29 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:29 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-1bbb9dd4-e470-496f-ae99-653f6bdaeeb4 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0/ips" status: 200 len: 108 microversion: 2.1 time: 0.034859 Apr 18 20:18:29 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 119/362] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:18:29 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0/ips => generated 108 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:30 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:18:30 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-fbd149c9-a109-455c-b70c-052c2687bbb6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 204 len: 0 microversion: 2.1 time: 0.108957 Apr 18 20:18:30 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 119/363] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:18:30 2023] DELETE /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:30 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-2c721ff6-29be-452b-bb97-b32e9b7c84af tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 200 len: 1670 microversion: 2.1 time: 0.161213 Apr 18 20:18:30 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 126/364] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:18:30 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:18:30 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-86ff3523-4941-4e89-965f-d17f6c6e25d7 req-597e00d1-2490-49cb-81c3-2f3ee0250551 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "name": "network-vif-unplugged", "status": "completed", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-86ff3523-4941-4e89-965f-d17f6c6e25d7 req-597e00d1-2490-49cb-81c3-2f3ee0250551 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-86ff3523-4941-4e89-965f-d17f6c6e25d7 req-597e00d1-2490-49cb-81c3-2f3ee0250551 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-86ff3523-4941-4e89-965f-d17f6c6e25d7 req-597e00d1-2490-49cb-81c3-2f3ee0250551 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-86ff3523-4941-4e89-965f-d17f6c6e25d7 req-597e00d1-2490-49cb-81c3-2f3ee0250551 service nova] Creating event network-vif-unplugged:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:18:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-86ff3523-4941-4e89-965f-d17f6c6e25d7 req-597e00d1-2490-49cb-81c3-2f3ee0250551 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033780 Apr 18 20:18:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 120/365] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-35162020-7695-4505-8f52-bc5e985f8b48 req-95edebf0-a0a4-46cf-b0e0-59c3a679106e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "name": "network-vif-deleted", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-35162020-7695-4505-8f52-bc5e985f8b48 req-95edebf0-a0a4-46cf-b0e0-59c3a679106e service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-35162020-7695-4505-8f52-bc5e985f8b48 req-95edebf0-a0a4-46cf-b0e0-59c3a679106e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-35162020-7695-4505-8f52-bc5e985f8b48 req-95edebf0-a0a4-46cf-b0e0-59c3a679106e service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-35162020-7695-4505-8f52-bc5e985f8b48 req-95edebf0-a0a4-46cf-b0e0-59c3a679106e service nova] Creating event network-vif-deleted:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:18:32 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-35162020-7695-4505-8f52-bc5e985f8b48 req-95edebf0-a0a4-46cf-b0e0-59c3a679106e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027996 Apr 18 20:18:32 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 120/366] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-187d1670-a716-4847-a022-b3b0f6fdb546 req-36c00e51-cfd6-4c8b-a7f3-7c9a68d71fb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17a771cf-a0fc-4385-b1d2-f98f7c2bdff0", "name": "network-vif-plugged", "status": "completed", "tag": "6a966f13-66ef-4785-ab82-c7ec63bf7173"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-187d1670-a716-4847-a022-b3b0f6fdb546 req-36c00e51-cfd6-4c8b-a7f3-7c9a68d71fb6 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-187d1670-a716-4847-a022-b3b0f6fdb546 req-36c00e51-cfd6-4c8b-a7f3-7c9a68d71fb6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-187d1670-a716-4847-a022-b3b0f6fdb546 req-36c00e51-cfd6-4c8b-a7f3-7c9a68d71fb6 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-187d1670-a716-4847-a022-b3b0f6fdb546 req-36c00e51-cfd6-4c8b-a7f3-7c9a68d71fb6 service nova] Creating event network-vif-plugged:6a966f13-66ef-4785-ab82-c7ec63bf7173 for instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 on user Apr 18 20:18:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-187d1670-a716-4847-a022-b3b0f6fdb546 req-36c00e51-cfd6-4c8b-a7f3-7c9a68d71fb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028932 Apr 18 20:18:32 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 127/367] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:37 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:37 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-00069a9d-0f69-45e4-9792-1dfd66798c76 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 200 len: 1495 microversion: 2.1 time: 0.333722 Apr 18 20:18:37 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 121/368] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:18:37 2023] GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 1495 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 6c0a5bc6-4536-4952-a5bd-990622ad400e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] HTTP exception thrown: Instance 6c0a5bc6-4536-4952-a5bd-990622ad400e could not be found. Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Request method failure captured: Apr 18 20:18:41 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e HTTP/1.1 Apr 18 20:18:41 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:18:41 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:18:41 user devstack@n-api.service[61422]: Connection: close Apr 18 20:18:41 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:18:41 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:18:41 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:18:41 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:18:41 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvnQA3r1N-wIRx8E9ap-QzJDWEdyJvp9r1rfevuGGuQtXkYQSgMhQfj41lBWW2bEQ44pDENmBrjre_eDTOI5di-zPUlO3WusUL9t2Cy2M-C7WcL-MBvSjVUCRVwGYT34zXmKSnux62HWd8hE6RnZgUUCEo33KGOwC0GzJNBpsi7B8J0 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Project-Id: b60e04e321f04d968e519604c9836836 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1681287712 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b60e04e321f04d968e519604c9836836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b60e04e321f04d968e519604c9836836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b60e04e321f04d968e519604c9836836"}]}] Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1681287712 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Tenant-Id: b60e04e321f04d968e519604c9836836 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1681287712 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-User: tempest-ServerRescueNegativeTestJSON-1681287712-project-member Apr 18 20:18:41 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:18:41 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:18:41 user devstack@n-api.service[61422]: X-User-Id: 8f8fb8390e03457580eda1c8e325cbb5 Apr 18 20:18:41 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1681287712-project-member Apr 18 20:18:41 user devstack@n-api.service[61422]: method: > Apr 18 20:18:41 user devstack@n-api.service[61422]: exception: Instance 6c0a5bc6-4536-4952-a5bd-990622ad400e could not be found. Apr 18 20:18:41 user devstack@n-api.service[61422]: action_args: {'id': '6c0a5bc6-4536-4952-a5bd-990622ad400e'} Apr 18 20:18:41 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c0a5bc6-4536-4952-a5bd-990622ad400e could not be found. Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c0a5bc6-4536-4952-a5bd-990622ad400e could not be found. Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c0a5bc6-4536-4952-a5bd-990622ad400e could not be found. Apr 18 20:18:41 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Returning 404 to user: Instance 6c0a5bc6-4536-4952-a5bd-990622ad400e could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:18:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-d3594225-412e-4ec4-8a6f-53c8c04075c9 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e" status: 404 len: 111 microversion: 2.1 time: 0.256576 Apr 18 20:18:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 121/369] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:18:41 2023] GET /compute/v2.1/servers/6c0a5bc6-4536-4952-a5bd-990622ad400e => generated 111 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:18:41 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-3f3767ff-c2e6-4be0-8316-59c441b78b81 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea" status: 204 len: 0 microversion: 2.1 time: 0.111421 Apr 18 20:18:41 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 128/370] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:18:41 2023] DELETE /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f8fb8390e03457580eda1c8e325cbb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b60e04e321f04d968e519604c9836836', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:18:41 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-79cc7961-265c-45dd-a424-6b63db953b3d tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea" status: 200 len: 1508 microversion: 2.1 time: 0.240876 Apr 18 20:18:41 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 122/371] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:18:41 2023] GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-9e2ea83b-2da5-4b71-b7da-f899e5b6cdbe req-efb6d36b-b0c2-4841-a50e-384336c0968c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b7bded-501f-4ff6-9d5f-ae1a15ea8cea", "name": "network-vif-unplugged", "status": "completed", "tag": "4d399ed7-5707-4e55-991c-e0ae1f1ead0f"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9e2ea83b-2da5-4b71-b7da-f899e5b6cdbe req-efb6d36b-b0c2-4841-a50e-384336c0968c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9e2ea83b-2da5-4b71-b7da-f899e5b6cdbe req-efb6d36b-b0c2-4841-a50e-384336c0968c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:41 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-9e2ea83b-2da5-4b71-b7da-f899e5b6cdbe req-efb6d36b-b0c2-4841-a50e-384336c0968c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-9e2ea83b-2da5-4b71-b7da-f899e5b6cdbe req-efb6d36b-b0c2-4841-a50e-384336c0968c service nova] Creating event network-vif-unplugged:4d399ed7-5707-4e55-991c-e0ae1f1ead0f for instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea on user Apr 18 20:18:41 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-9e2ea83b-2da5-4b71-b7da-f899e5b6cdbe req-efb6d36b-b0c2-4841-a50e-384336c0968c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030231 Apr 18 20:18:41 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 122/372] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:42 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-abfadb75-2c65-4506-bbb0-1dc5f8bca1a0 req-5c36c591-0d61-451b-abf6-615f68423dcf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b7bded-501f-4ff6-9d5f-ae1a15ea8cea", "name": "network-vif-deleted", "tag": "4d399ed7-5707-4e55-991c-e0ae1f1ead0f"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-abfadb75-2c65-4506-bbb0-1dc5f8bca1a0 req-5c36c591-0d61-451b-abf6-615f68423dcf service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-abfadb75-2c65-4506-bbb0-1dc5f8bca1a0 req-5c36c591-0d61-451b-abf6-615f68423dcf service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:42 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-abfadb75-2c65-4506-bbb0-1dc5f8bca1a0 req-5c36c591-0d61-451b-abf6-615f68423dcf service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:43 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-abfadb75-2c65-4506-bbb0-1dc5f8bca1a0 req-5c36c591-0d61-451b-abf6-615f68423dcf service nova] Creating event network-vif-deleted:4d399ed7-5707-4e55-991c-e0ae1f1ead0f for instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea on user Apr 18 20:18:43 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-abfadb75-2c65-4506-bbb0-1dc5f8bca1a0 req-5c36c591-0d61-451b-abf6-615f68423dcf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028413 Apr 18 20:18:43 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 129/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:43 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-92ce43ca-4b74-48e2-9ac3-faba0d4180a1 req-1a866efe-114f-4040-bb71-ddbb56d7051a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67b7bded-501f-4ff6-9d5f-ae1a15ea8cea", "name": "network-vif-plugged", "status": "completed", "tag": "4d399ed7-5707-4e55-991c-e0ae1f1ead0f"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-92ce43ca-4b74-48e2-9ac3-faba0d4180a1 req-1a866efe-114f-4040-bb71-ddbb56d7051a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:18:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-92ce43ca-4b74-48e2-9ac3-faba0d4180a1 req-1a866efe-114f-4040-bb71-ddbb56d7051a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:18:43 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-92ce43ca-4b74-48e2-9ac3-faba0d4180a1 req-1a866efe-114f-4040-bb71-ddbb56d7051a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:18:43 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-92ce43ca-4b74-48e2-9ac3-faba0d4180a1 req-1a866efe-114f-4040-bb71-ddbb56d7051a service nova] Creating event network-vif-plugged:4d399ed7-5707-4e55-991c-e0ae1f1ead0f for instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea on user Apr 18 20:18:43 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-92ce43ca-4b74-48e2-9ac3-faba0d4180a1 req-1a866efe-114f-4040-bb71-ddbb56d7051a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027827 Apr 18 20:18:43 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 123/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:18:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:47 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-96a519b1-e2d8-4ab6-9dfb-e240c8e0accb tempest-TestShelveInstance-75780490 tempest-TestShelveInstance-75780490-project-member] Action: 'create', calling method: .version_select at 0x7fb7738dcc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-539286776", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUPF7cjExB1rx2SugkO28Pq12UmNcRxel8tipX84dJV2IS8VEcqRk6soPmdefAiYwVhebAYfadoFKC2kSid5+XZ7y0xEN6fqYDfOOYt1GFr+GmYQRod6gVDYnUocPFrcQ=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:18:47 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-96a519b1-e2d8-4ab6-9dfb-e240c8e0accb tempest-TestShelveInstance-75780490 tempest-TestShelveInstance-75780490-project-member] Getting quotas for project f61444b942c2415bb6e5c29cefd186a7. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:18:47 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-96a519b1-e2d8-4ab6-9dfb-e240c8e0accb tempest-TestShelveInstance-75780490 tempest-TestShelveInstance-75780490-project-member] Getting quotas for user fe41b717187f48e3a07908b9a3aaf85a and project f61444b942c2415bb6e5c29cefd186a7. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:18:47 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-96a519b1-e2d8-4ab6-9dfb-e240c8e0accb tempest-TestShelveInstance-75780490 tempest-TestShelveInstance-75780490-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.131009 Apr 18 20:18:47 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 123/375] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:18:47 2023] POST /compute/v2.1/os-keypairs => generated 396 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:18:50 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a518242f-2420-4918-aac3-657427d612b1 tempest-TestShelveInstance-75780490 tempest-TestShelveInstance-75780490-project-member] Calling method '.version_select at 0x7fb7737c5360>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:18:50 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-a518242f-2420-4918-aac3-657427d612b1 tempest-TestShelveInstance-75780490 tempest-TestShelveInstance-75780490-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-539286776" status: 202 len: 0 microversion: 2.1 time: 0.023542 Apr 18 20:18:50 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 130/376] 10.0.0.210 () {62 vars in 1328 bytes} [Tue Apr 18 20:18:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-539286776 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=12 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=26 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] [instance: 349b3f34-40ef-416e-a077-7cc112925c2b] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:04 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] HTTP exception thrown: Instance 349b3f34-40ef-416e-a077-7cc112925c2b could not be found. Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Request method failure captured: Apr 18 20:19:04 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b HTTP/1.1 Apr 18 20:19:04 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:19:04 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:19:04 user devstack@n-api.service[61421]: Connection: close Apr 18 20:19:04 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:19:04 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:19:04 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:19:04 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:19:04 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvkEp9tBh9JgSefVTQbPbckzU2zbiAF2TonKcmCIymhDNgqAw9wQgxR2ZNGQsLA6vkEmyHynGzW543TY8xcpIxpgBf9r9AIjEWNtX2mgtTCR6kCYQ3nfv82A0ipYjLT3a-qyXZdEbRXRk6tYvRHAQCOql8E3SoH35JyupAtxKP1DcXM Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Project-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f51729e3d9f3464789aa11df3369e717"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f51729e3d9f3464789aa11df3369e717"}]}] Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Tenant-Id: f51729e3d9f3464789aa11df3369e717 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-User: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:19:04 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:19:04 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:19:04 user devstack@n-api.service[61421]: X-User-Id: 4918574af24b49d1b355bd3970ef6be4 Apr 18 20:19:04 user devstack@n-api.service[61421]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member Apr 18 20:19:04 user devstack@n-api.service[61421]: method: > Apr 18 20:19:04 user devstack@n-api.service[61421]: exception: Instance 349b3f34-40ef-416e-a077-7cc112925c2b could not be found. Apr 18 20:19:04 user devstack@n-api.service[61421]: action_args: {'id': '349b3f34-40ef-416e-a077-7cc112925c2b'} Apr 18 20:19:04 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349b3f34-40ef-416e-a077-7cc112925c2b could not be found. Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349b3f34-40ef-416e-a077-7cc112925c2b could not be found. Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349b3f34-40ef-416e-a077-7cc112925c2b could not be found. Apr 18 20:19:04 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:04 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] Returning 404 to user: Instance 349b3f34-40ef-416e-a077-7cc112925c2b could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:19:04 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-ac0d74db-a41b-476e-874e-2fcace9142a2 tempest-ServerBootFromVolumeStableRescueTest-740417585 tempest-ServerBootFromVolumeStableRescueTest-740417585-project-member] 10.0.0.210 "GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b" status: 404 len: 111 microversion: 2.87 time: 0.033180 Apr 18 20:19:04 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 124/377] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:19:04 2023] GET /compute/v2.1/servers/349b3f34-40ef-416e-a077-7cc112925c2b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:19:15 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:15 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:15 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4cf22d5e-6143-4c05-80bc-30f8ddce43e1 tempest-TestVolumeBootPattern-813925224 tempest-TestVolumeBootPattern-813925224-project-member] Action: 'create', calling method: .version_select at 0x7fb7738dd510>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1846582996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMwKV2s0FpLj4cGVjIl3G0R9kjNi5alo6N9th0So99gcdS22pqjf52yEuLFZseVpLY5X5QjIzxIjg0Fc9C771IgrcEroauwJmtEf/R8CBOls1g0NVgSmaL76oQVxwTifgw=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:15 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-4cf22d5e-6143-4c05-80bc-30f8ddce43e1 tempest-TestVolumeBootPattern-813925224 tempest-TestVolumeBootPattern-813925224-project-member] Getting quotas for project 519941c56e0e4da4a8d6365718dd87df. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:19:15 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-4cf22d5e-6143-4c05-80bc-30f8ddce43e1 tempest-TestVolumeBootPattern-813925224 tempest-TestVolumeBootPattern-813925224-project-member] Getting quotas for user 65de6802754f4355b4baaef50d5f4f5d and project 519941c56e0e4da4a8d6365718dd87df. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:19:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4cf22d5e-6143-4c05-80bc-30f8ddce43e1 tempest-TestVolumeBootPattern-813925224 tempest-TestVolumeBootPattern-813925224-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.054281 Apr 18 20:19:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 124/378] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:19:15 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:18 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:18 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:18 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-d3650f2d-aca3-4582-b057-6fd3c4247d19 tempest-TestVolumeBootPattern-813925224 tempest-TestVolumeBootPattern-813925224-project-member] Calling method '.version_select at 0x7fb77362cdc0>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:18 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-d3650f2d-aca3-4582-b057-6fd3c4247d19 tempest-TestVolumeBootPattern-813925224 tempest-TestVolumeBootPattern-813925224-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846582996" status: 202 len: 0 microversion: 2.1 time: 0.028381 Apr 18 20:19:18 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 131/379] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 18 20:19:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1846582996 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:19:20 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:20 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:21 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:19:21 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 HTTP/1.1 Apr 18 20:19:21 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:19:21 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:19:21 user devstack@n-api.service[61421]: Connection: close Apr 18 20:19:21 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:19:21 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:19:21 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:19:21 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:19:21 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:19:21 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:19:21 user devstack@n-api.service[61421]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:19:21 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:19:21 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:19:21 user devstack@n-api.service[61421]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:19:21 user devstack@n-api.service[61421]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:19:21 user devstack@n-api.service[61421]: method: > Apr 18 20:19:21 user devstack@n-api.service[61421]: exception: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:19:21 user devstack@n-api.service[61421]: action_args: {'id': '17a771cf-a0fc-4385-b1d2-f98f7c2bdff0'} Apr 18 20:19:21 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:19:21 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:19:21 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:19:21 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-4370a6a3-9838-4e04-8e35-57cdd212a295 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 404 len: 111 microversion: 2.1 time: 0.258482 Apr 18 20:19:21 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 125/380] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:19:20 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 111 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:19:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4210d752-3bba-4e15-8cda-6bcbb9cdae1e tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '.version_select at 0x7fb7738dfc70>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4210d752-3bba-4e15-8cda-6bcbb9cdae1e tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054033936" status: 202 len: 0 microversion: 2.1 time: 0.022499 Apr 18 20:19:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 125/381] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 20:19:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2054033936 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:19:22 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-0fe3d5d6-cfa7-471f-9a96-dd869415e592 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Action: 'create', calling method: .version_select at 0x7fb7737c6b90>, body: {"keypair": {"name": "tempest-keypair-1517828598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVhAvTgDPHU/ZvujjugRWQ8k6v1KeXVwH8dFPoSiRg02m/7+EMa0D6e/HC44dlX/LWpZPduD/MyYo5T7CW4Pm2kZNwNTG1hEbZw1WwZZe4cmP42aN4IYZic7QjwhQHDGw=="}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:22 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-0fe3d5d6-cfa7-471f-9a96-dd869415e592 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:19:22 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-0fe3d5d6-cfa7-471f-9a96-dd869415e592 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for user 4859711fcdef4d91ae9caff4bacc85fe and project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'key_pairs'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:19:22 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-0fe3d5d6-cfa7-471f-9a96-dd869415e592 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054151 Apr 18 20:19:22 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 132/382] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:19:22 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:19:24 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1006297411", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "ef116b62-6faf-4010-a37c-960d9a4b6b02"}], "security_groups": [{"name": "tempest-securitygroup--1441897049"}], "key_name": "tempest-keypair-1517828598", "user_data": "}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:24 user devstack@n-api.service[61421]: DEBUG nova.network.neutron [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] validate_networks() for [('ef116b62-6faf-4010-a37c-960d9a4b6b02', None, None, None, None, None)] {{(pid=61421) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Flavor limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Image limits 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Flavor pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Image pref 0:0:0 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.virt.hardware [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61421) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Getting quotas for user 4859711fcdef4d91ae9caff4bacc85fe and project 3da3c99e5d684aab877826bdbf471e3f. Resources: {'cores', 'ram', 'instances'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Going to run 1 instances... {{(pid=61421) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:19:25 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61421) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:19:25 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-953cbafe-99dc-4fa3-a47b-090efa10f6f6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.943396 Apr 18 20:19:25 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 126/383] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:19:24 2023] POST /compute/v2.1/servers => generated 400 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 18 20:19:25 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:25 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-6ea65a14-f1e3-4fcf-bc3a-052f8028ed14 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:25 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-6ea65a14-f1e3-4fcf-bc3a-052f8028ed14 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:25 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-6ea65a14-f1e3-4fcf-bc3a-052f8028ed14 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:19:25 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-6ea65a14-f1e3-4fcf-bc3a-052f8028ed14 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 200 len: 1236 microversion: 2.1 time: 0.067968 Apr 18 20:19:25 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 126/384] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:19:25 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:19:27 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-338fa34a-92ef-4507-89c2-2e3378cdfa06 req-c19adc78-f408-43af-8d21-d50905d52d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:27 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-338fa34a-92ef-4507-89c2-2e3378cdfa06 req-c19adc78-f408-43af-8d21-d50905d52d14 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:27 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-338fa34a-92ef-4507-89c2-2e3378cdfa06 req-c19adc78-f408-43af-8d21-d50905d52d14 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:27 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-338fa34a-92ef-4507-89c2-2e3378cdfa06 req-c19adc78-f408-43af-8d21-d50905d52d14 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:27 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-338fa34a-92ef-4507-89c2-2e3378cdfa06 req-c19adc78-f408-43af-8d21-d50905d52d14 service nova] Creating event network-changed:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:19:27 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-338fa34a-92ef-4507-89c2-2e3378cdfa06 req-c19adc78-f408-43af-8d21-d50905d52d14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027645 Apr 18 20:19:27 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 133/385] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:28 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Going to try to terminate instance {{(pid=61421) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:19:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-60a5d3e0-7f04-4eaf-b7ba-b2bf1266b7ea tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 204 len: 0 microversion: 2.1 time: 0.146141 Apr 18 20:19:28 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 127/386] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:19:28 2023] DELETE /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-705caea9-daf2-47b2-8d78-015385e031e4 req-78a8d1e5-bd11-4fc3-8828-42952ee3eee5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "name": "network-vif-unplugged", "status": "completed", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-705caea9-daf2-47b2-8d78-015385e031e4 req-78a8d1e5-bd11-4fc3-8828-42952ee3eee5 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-705caea9-daf2-47b2-8d78-015385e031e4 req-78a8d1e5-bd11-4fc3-8828-42952ee3eee5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-705caea9-daf2-47b2-8d78-015385e031e4 req-78a8d1e5-bd11-4fc3-8828-42952ee3eee5 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-705caea9-daf2-47b2-8d78-015385e031e4 req-78a8d1e5-bd11-4fc3-8828-42952ee3eee5 service nova] Creating event network-vif-unplugged:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:19:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-705caea9-daf2-47b2-8d78-015385e031e4 req-78a8d1e5-bd11-4fc3-8828-42952ee3eee5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035248 Apr 18 20:19:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 134/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:28 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14239df813d442792ffabf053449b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e40bd5776b645d0b587b8aac24953c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:19:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-fd260761-d7c2-457f-8332-0be91a64a738 tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 200 len: 1663 microversion: 2.1 time: 0.426013 Apr 18 20:19:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 127/388] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:19:28 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 1663 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:19:30 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-daa865f7-ccc6-4820-81ff-7215a8107f30 req-ad70636d-c6a0-4776-94e3-1e224c377ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "name": "network-vif-deleted", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-daa865f7-ccc6-4820-81ff-7215a8107f30 req-ad70636d-c6a0-4776-94e3-1e224c377ce7 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-daa865f7-ccc6-4820-81ff-7215a8107f30 req-ad70636d-c6a0-4776-94e3-1e224c377ce7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:30 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-daa865f7-ccc6-4820-81ff-7215a8107f30 req-ad70636d-c6a0-4776-94e3-1e224c377ce7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-daa865f7-ccc6-4820-81ff-7215a8107f30 req-ad70636d-c6a0-4776-94e3-1e224c377ce7 service nova] Creating event network-vif-deleted:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:19:30 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-daa865f7-ccc6-4820-81ff-7215a8107f30 req-ad70636d-c6a0-4776-94e3-1e224c377ce7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046928 Apr 18 20:19:30 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 128/389] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-2b784c72-c405-4283-a7b2-569d2238ca30 req-b3cc8058-ddeb-4949-9b91-10cb550f06f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb", "name": "network-vif-plugged", "status": "completed", "tag": "78169254-dc0f-4d0c-8e27-65067ffd54bf"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-2b784c72-c405-4283-a7b2-569d2238ca30 req-b3cc8058-ddeb-4949-9b91-10cb550f06f7 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-2b784c72-c405-4283-a7b2-569d2238ca30 req-b3cc8058-ddeb-4949-9b91-10cb550f06f7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-2b784c72-c405-4283-a7b2-569d2238ca30 req-b3cc8058-ddeb-4949-9b91-10cb550f06f7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-2b784c72-c405-4283-a7b2-569d2238ca30 req-b3cc8058-ddeb-4949-9b91-10cb550f06f7 service nova] Creating event network-vif-plugged:78169254-dc0f-4d0c-8e27-65067ffd54bf for instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb on user Apr 18 20:19:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-2b784c72-c405-4283-a7b2-569d2238ca30 req-b3cc8058-ddeb-4949-9b91-10cb550f06f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Apr 18 20:19:30 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 135/390] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] [instance: 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] HTTP exception thrown: Instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea could not be found. Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Request method failure captured: Apr 18 20:19:31 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea HTTP/1.1 Apr 18 20:19:31 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:19:31 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:19:31 user devstack@n-api.service[61422]: Connection: close Apr 18 20:19:31 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:19:31 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:19:31 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:19:31 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:19:31 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvnQA3r1N-wIRx8E9ap-QzJDWEdyJvp9r1rfevuGGuQtXkYQSgMhQfj41lBWW2bEQ44pDENmBrjre_eDTOI5di-zPUlO3WusUL9t2Cy2M-C7WcL-MBvSjVUCRVwGYT34zXmKSnux62HWd8hE6RnZgUUCEo33KGOwC0GzJNBpsi7B8J0 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Project-Id: b60e04e321f04d968e519604c9836836 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1681287712 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b60e04e321f04d968e519604c9836836"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b60e04e321f04d968e519604c9836836"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b60e04e321f04d968e519604c9836836"}]}] Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1681287712 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Tenant-Id: b60e04e321f04d968e519604c9836836 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1681287712 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-User: tempest-ServerRescueNegativeTestJSON-1681287712-project-member Apr 18 20:19:31 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:19:31 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:19:31 user devstack@n-api.service[61422]: X-User-Id: 8f8fb8390e03457580eda1c8e325cbb5 Apr 18 20:19:31 user devstack@n-api.service[61422]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1681287712-project-member Apr 18 20:19:31 user devstack@n-api.service[61422]: method: > Apr 18 20:19:31 user devstack@n-api.service[61422]: exception: Instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea could not be found. Apr 18 20:19:31 user devstack@n-api.service[61422]: action_args: {'id': '67b7bded-501f-4ff6-9d5f-ae1a15ea8cea'} Apr 18 20:19:31 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea could not be found. Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea could not be found. Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea could not be found. Apr 18 20:19:31 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:19:31 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] Returning 404 to user: Instance 67b7bded-501f-4ff6-9d5f-ae1a15ea8cea could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:19:31 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3c1565c0-12f7-4960-b436-b84075337934 tempest-ServerRescueNegativeTestJSON-1681287712 tempest-ServerRescueNegativeTestJSON-1681287712-project-member] 10.0.0.210 "GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea" status: 404 len: 111 microversion: 2.1 time: 0.029007 Apr 18 20:19:31 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 128/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:19:31 2023] GET /compute/v2.1/servers/67b7bded-501f-4ff6-9d5f-ae1a15ea8cea => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:19:32 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "name": "network-vif-plugged", "status": "completed", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}, {"server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "name": "network-vif-plugged", "status": "completed", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] Creating event network-vif-plugged:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:19:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] Creating event network-vif-plugged:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:19:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-f404a3ea-0e5b-4ae9-ae2e-0159a4a6fac8 req-12152592-88f2-407a-9517-7718604b9623 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039614 Apr 18 20:19:32 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 129/392] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:32 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:37 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Going to try to terminate instance {{(pid=61420) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:19:37 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-5ace8c13-db42-4d64-8986-4165fff11346 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 204 len: 0 microversion: 2.1 time: 0.136840 Apr 18 20:19:37 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 136/393] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:19:37 2023] DELETE /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:37 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:37 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:37 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:37 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-ae0348d9-5756-4430-a209-f0e9e77e05b2 req-23cd8856-1edc-43ad-a7be-70c0a08467bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db39cb17-b71e-4aef-a854-cd1da1f9ab05", "name": "network-vif-unplugged", "status": "completed", "tag": "22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-ae0348d9-5756-4430-a209-f0e9e77e05b2 req-23cd8856-1edc-43ad-a7be-70c0a08467bc service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-ae0348d9-5756-4430-a209-f0e9e77e05b2 req-23cd8856-1edc-43ad-a7be-70c0a08467bc service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:37 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-ae0348d9-5756-4430-a209-f0e9e77e05b2 req-23cd8856-1edc-43ad-a7be-70c0a08467bc service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:37 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-ae0348d9-5756-4430-a209-f0e9e77e05b2 req-23cd8856-1edc-43ad-a7be-70c0a08467bc service nova] Creating event network-vif-unplugged:22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a for instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 on user Apr 18 20:19:37 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-ae0348d9-5756-4430-a209-f0e9e77e05b2 req-23cd8856-1edc-43ad-a7be-70c0a08467bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040017 Apr 18 20:19:37 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:19:38 user devstack@n-api.service[61422]: DEBUG nova.policy [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61422) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:19:38 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-64b1a19b-5685-40e2-b2f4-a26d0172589c tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 200 len: 1501 microversion: 2.1 time: 0.612772 Apr 18 20:19:38 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 129/395] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:19:37 2023] GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 1501 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:19:39 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db39cb17-b71e-4aef-a854-cd1da1f9ab05", "name": "network-vif-plugged", "status": "completed", "tag": "22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a"}, {"server_uuid": "db39cb17-b71e-4aef-a854-cd1da1f9ab05", "name": "network-vif-deleted", "tag": "22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:19:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:19:39 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:19:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] Creating event network-vif-plugged:22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a for instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 on user Apr 18 20:19:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] Creating event network-vif-deleted:22f3a00a-cc2d-4d96-951c-b9ba8d1fda8a for instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 on user Apr 18 20:19:39 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-dbdb53f5-5f5c-4853-ab27-34ace85ccfff req-832559f1-af62-451d-b543-9a83e2d3793c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040892 Apr 18 20:19:39 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 137/396] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:19:45 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-7540f4a8-a3d5-43af-8cdc-dcf25355f873 tempest-TestStampPattern-1673824752 tempest-TestStampPattern-1673824752-project-member] Action: 'create', calling method: .version_select at 0x7fb773af4f70>, body: {"keypair": {"name": "tempest-TestStampPattern-1298483156", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGvr6LVX++Eiu1YUChLwz8vfk2221FtuHl8Dimhj0yGyrId1kYUIwoaciVJNePhyHgt9jJ5mPcCKIoHCIkzJ1X5yUu1kWdOBMJvZZbJiWgwoC+grGJXoD4Bx81c/aLPEg=="}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:19:45 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-7540f4a8-a3d5-43af-8cdc-dcf25355f873 tempest-TestStampPattern-1673824752 tempest-TestStampPattern-1673824752-project-member] Getting quotas for project f4e60546acfa43b3944396fcb79071a2. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:19:45 user devstack@n-api.service[61421]: DEBUG nova.quota [None req-7540f4a8-a3d5-43af-8cdc-dcf25355f873 tempest-TestStampPattern-1673824752 tempest-TestStampPattern-1673824752-project-member] Getting quotas for user 1f5c22cddac04fd98500953cd77ef426 and project f4e60546acfa43b3944396fcb79071a2. Resources: {'key_pairs'} {{(pid=61421) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:19:45 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-7540f4a8-a3d5-43af-8cdc-dcf25355f873 tempest-TestStampPattern-1673824752 tempest-TestStampPattern-1673824752-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.276821 Apr 18 20:19:45 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 131/397] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:19:44 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:19:48 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-bd12df83-387b-4534-82b6-8ea110f0ca60 tempest-TestStampPattern-1673824752 tempest-TestStampPattern-1673824752-project-member] Calling method '.version_select at 0x7fb7738dce50>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:19:48 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:19:48 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-bd12df83-387b-4534-82b6-8ea110f0ca60 tempest-TestStampPattern-1673824752 tempest-TestStampPattern-1673824752-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1298483156" status: 202 len: 0 microversion: 2.1 time: 0.022533 Apr 18 20:19:48 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 130/398] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:19:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1298483156 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:15 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:20:15 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-a588889c-0b8b-4a94-8fb8-ddedd5d9aa77 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 200 len: 1545 microversion: 2.1 time: 0.491911 Apr 18 20:20:15 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 138/399] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:20:15 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 1545 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] [instance: f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:18 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] HTTP exception thrown: Instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb could not be found. Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Request method failure captured: Apr 18 20:20:18 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb HTTP/1.1 Apr 18 20:20:18 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:20:18 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:20:18 user devstack@n-api.service[61421]: Connection: close Apr 18 20:20:18 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:20:18 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:20:18 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:20:18 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:20:18 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvk7vkuYYw262LL_pl7oGPTGU3_PDfXNPurnFc4V-bw75yx-OxZGbpwA-x6NqcaQ94sKgnQqgajnK9IbMfdi8DGtVa0AWLRsshhFjdKw0cbtxvAWE2OHyRH5XZVkQkJjtWeJcjW7rx-CZWGeAyblvBYOMUS7gwJeOWoBdrcDpZeZvAo Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Project-Id: 6e40bd5776b645d0b587b8aac24953c9 Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Project-Name: tempest-ServerActionsTestJSON-1783964211 Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e40bd5776b645d0b587b8aac24953c9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6e40bd5776b645d0b587b8aac24953c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6e40bd5776b645d0b587b8aac24953c9"}]}] Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Tenant: tempest-ServerActionsTestJSON-1783964211 Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Tenant-Id: 6e40bd5776b645d0b587b8aac24953c9 Apr 18 20:20:18 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-ServerActionsTestJSON-1783964211 Apr 18 20:20:18 user devstack@n-api.service[61421]: X-User: tempest-ServerActionsTestJSON-1783964211-project-member Apr 18 20:20:18 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:20:18 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:20:18 user devstack@n-api.service[61421]: X-User-Id: a14239df813d442792ffabf053449b8a Apr 18 20:20:18 user devstack@n-api.service[61421]: X-User-Name: tempest-ServerActionsTestJSON-1783964211-project-member Apr 18 20:20:18 user devstack@n-api.service[61421]: method: > Apr 18 20:20:18 user devstack@n-api.service[61421]: exception: Instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb could not be found. Apr 18 20:20:18 user devstack@n-api.service[61421]: action_args: {'id': 'f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb'} Apr 18 20:20:18 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb could not be found. Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb could not be found. Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb could not be found. Apr 18 20:20:18 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:20:18 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Returning 404 to user: Instance f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:20:18 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-0ceeb0ce-2e4c-4210-89c8-5155f62c08fc tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb" status: 404 len: 111 microversion: 2.1 time: 0.039406 Apr 18 20:20:18 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:20:18 2023] GET /compute/v2.1/servers/f1bd755d-f8c2-40c9-9845-2b20cf8ba3bb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:20:18 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=14 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:18 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-230742bd-2661-4fdb-b8f4-2d0c3e892f2a tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] Calling method '.version_select at 0x7fb773800940>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:20:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-230742bd-2661-4fdb-b8f4-2d0c3e892f2a tempest-ServerActionsTestJSON-1783964211 tempest-ServerActionsTestJSON-1783964211-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208135863" status: 202 len: 0 microversion: 2.1 time: 0.026914 Apr 18 20:20:18 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 131/401] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 20:20:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208135863 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] HTTP exception thrown: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Request method failure captured: Apr 18 20:20:28 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 HTTP/1.1 Apr 18 20:20:28 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:20:28 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:20:28 user devstack@n-api.service[61420]: Connection: close Apr 18 20:20:28 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:20:28 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:20:28 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:20:28 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:20:28 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvp6_lVeLNtIHk4InqAStHg8-D73cDk8h8pa7Zo4i9HN72thQPlszg8PRxvt3tLnSt5sRha44RCrrusDiJA_TCaaGO01HHTdnJhKO6Oo88ogaA63NjvbMPPJX0F8QZgAYM3YHmKYJ6MImTWvWP2RyEmcDhmRe2dFsMB50RS-O2J5Tk8 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Project-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Project-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b332619e85294fc182a0e341f353d0c3"}]}] Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Tenant: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Tenant-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:20:28 user devstack@n-api.service[61420]: X-User: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:20:28 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:20:28 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:20:28 user devstack@n-api.service[61420]: X-User-Id: 79a57c819f0f4dd4a36eadbc002418db Apr 18 20:20:28 user devstack@n-api.service[61420]: X-User-Name: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:20:28 user devstack@n-api.service[61420]: method: > Apr 18 20:20:28 user devstack@n-api.service[61420]: exception: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:20:28 user devstack@n-api.service[61420]: action_args: {'id': 'db39cb17-b71e-4aef-a854-cd1da1f9ab05'} Apr 18 20:20:28 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:20:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:20:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Returning 404 to user: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:20:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4c826637-c927-4b8b-94e9-3b4a1c68c67d tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 404 len: 111 microversion: 2.1 time: 0.046418 Apr 18 20:20:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 139/402] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:20:28 2023] GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:28 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:20:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-5bfeba87-5962-4616-bb9f-52305578d27a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1493 microversion: 2.1 time: 0.237145 Apr 18 20:20:28 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 133/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:20:28 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1493 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:20:57 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:57 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-3ab3b59c-6045-4cda-922d-0a4402f18664 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Action: 'create', calling method: .version_select at 0x7fb7738dc700>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-636534463", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGdOCJLksPbdPHOWgL6+zoDQ41aHu3Coj9FF/250XHyci5EgYNJWrV7nW9IH/AjUMy6wqqsWrMcMyE0r3Uo7IRKDY7jLopVaN8xh+syaHW/3KNBB+FMKpsQnk9qJw2dq/A=="}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:20:57 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-3ab3b59c-6045-4cda-922d-0a4402f18664 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Getting quotas for project 9d2ead7add0445e6867d53dd4b883f5b. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:20:57 user devstack@n-api.service[61422]: DEBUG nova.quota [None req-3ab3b59c-6045-4cda-922d-0a4402f18664 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Getting quotas for user aa0e46bfff374817aa1b04d614b83a60 and project 9d2ead7add0445e6867d53dd4b883f5b. Resources: {'key_pairs'} {{(pid=61422) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:20:57 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-3ab3b59c-6045-4cda-922d-0a4402f18664 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.269425 Apr 18 20:20:57 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 132/404] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:20:57 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:20:58 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-397132039", "imageRef": "bced5834-bb13-4a51-9ae0-beca997a2850", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-636534463", "security_groups": [{"name": "tempest-secgroup-smoke-785249105"}], "networks": [{"uuid": "415dac00-c09b-4e5a-9b19-32f4ca53d707"}]}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:20:58 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:58 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:58 user devstack@n-api.service[61420]: DEBUG nova.network.neutron [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] validate_networks() for [('415dac00-c09b-4e5a-9b19-32f4ca53d707', None, None, None, None, None)] {{(pid=61420) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Flavor limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Image limits 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Flavor pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Image pref 0:0:0 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.virt.hardware [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61420) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Getting quotas for project 9d2ead7add0445e6867d53dd4b883f5b. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.quota [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Getting quotas for user aa0e46bfff374817aa1b04d614b83a60 and project 9d2ead7add0445e6867d53dd4b883f5b. Resources: {'cores', 'ram', 'instances'} {{(pid=61420) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Going to run 1 instances... {{(pid=61420) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:20:59 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='bced5834-bb13-4a51-9ae0-beca997a2850',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61420) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:20:59 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-18821b0d-acaf-42db-ac04-c01e7876d8e9 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.792077 Apr 18 20:20:59 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 140/405] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:20:58 2023] POST /compute/v2.1/servers => generated 403 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:20:59 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-98edcf89-6d7e-4c58-bbb1-736734ccdbac tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:20:59 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-98edcf89-6d7e-4c58-bbb1-736734ccdbac tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:20:59 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:59 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=8 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:20:59 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-98edcf89-6d7e-4c58-bbb1-736734ccdbac tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e46bfff374817aa1b04d614b83a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2ead7add0445e6867d53dd4b883f5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:20:59 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-98edcf89-6d7e-4c58-bbb1-736734ccdbac tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6" status: 200 len: 1255 microversion: 2.1 time: 0.069952 Apr 18 20:20:59 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 134/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:20:59 2023] GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 => generated 1255 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:21:01 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-54ede603-96e3-4b1e-8587-08c6260470b3 req-067f3839-5d49-44e4-a51f-3dc365051fba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e3a3b5e-5853-492a-b48a-1819643934b6", "tag": "b82e725d-e7be-4b7f-bb40-d146e98c5416"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:21:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-54ede603-96e3-4b1e-8587-08c6260470b3 req-067f3839-5d49-44e4-a51f-3dc365051fba service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-54ede603-96e3-4b1e-8587-08c6260470b3 req-067f3839-5d49-44e4-a51f-3dc365051fba service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:01 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-54ede603-96e3-4b1e-8587-08c6260470b3 req-067f3839-5d49-44e4-a51f-3dc365051fba service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:01 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-54ede603-96e3-4b1e-8587-08c6260470b3 req-067f3839-5d49-44e4-a51f-3dc365051fba service nova] Creating event network-changed:b82e725d-e7be-4b7f-bb40-d146e98c5416 for instance 4e3a3b5e-5853-492a-b48a-1819643934b6 on user Apr 18 20:21:02 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-54ede603-96e3-4b1e-8587-08c6260470b3 req-067f3839-5d49-44e4-a51f-3dc365051fba service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088818 Apr 18 20:21:02 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 133/407] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:21:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:04 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-174adfdb-c6b9-4b5b-a396-c7c665c622ae req-6cd74995-9609-463e-a212-44a97e35ab67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3a3b5e-5853-492a-b48a-1819643934b6", "name": "network-vif-plugged", "status": "completed", "tag": "b82e725d-e7be-4b7f-bb40-d146e98c5416"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:21:04 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-174adfdb-c6b9-4b5b-a396-c7c665c622ae req-6cd74995-9609-463e-a212-44a97e35ab67 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:04 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-174adfdb-c6b9-4b5b-a396-c7c665c622ae req-6cd74995-9609-463e-a212-44a97e35ab67 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:04 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-174adfdb-c6b9-4b5b-a396-c7c665c622ae req-6cd74995-9609-463e-a212-44a97e35ab67 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:04 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-174adfdb-c6b9-4b5b-a396-c7c665c622ae req-6cd74995-9609-463e-a212-44a97e35ab67 service nova] Creating event network-vif-plugged:b82e725d-e7be-4b7f-bb40-d146e98c5416 for instance 4e3a3b5e-5853-492a-b48a-1819643934b6 on user Apr 18 20:21:04 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-174adfdb-c6b9-4b5b-a396-c7c665c622ae req-6cd74995-9609-463e-a212-44a97e35ab67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034522 Apr 18 20:21:04 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 141/408] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:21:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:06 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-b8abe31e-6926-4425-b644-e64b6bbae96a req-b4e495ea-f91c-4b4e-bb38-29b1447e7659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3a3b5e-5853-492a-b48a-1819643934b6", "name": "network-vif-plugged", "status": "completed", "tag": "b82e725d-e7be-4b7f-bb40-d146e98c5416"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:21:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b8abe31e-6926-4425-b644-e64b6bbae96a req-b4e495ea-f91c-4b4e-bb38-29b1447e7659 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b8abe31e-6926-4425-b644-e64b6bbae96a req-b4e495ea-f91c-4b4e-bb38-29b1447e7659 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:06 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-b8abe31e-6926-4425-b644-e64b6bbae96a req-b4e495ea-f91c-4b4e-bb38-29b1447e7659 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:06 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-b8abe31e-6926-4425-b644-e64b6bbae96a req-b4e495ea-f91c-4b4e-bb38-29b1447e7659 service nova] Creating event network-vif-plugged:b82e725d-e7be-4b7f-bb40-d146e98c5416 for instance 4e3a3b5e-5853-492a-b48a-1819643934b6 on user Apr 18 20:21:06 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-b8abe31e-6926-4425-b644-e64b6bbae96a req-b4e495ea-f91c-4b4e-bb38-29b1447e7659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033277 Apr 18 20:21:06 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 135/409] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:21:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell0:SELECT=4 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=2 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:16 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-eaa7d7c7-4347-4447-b41e-ab8f28b5976b tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.182274 Apr 18 20:21:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 134/410] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:21:16 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a/os-interface => generated 282 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell0:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-6d1c11da-7794-43bd-b9d3-8b294341949f req-88755fcb-43da-4c9c-ba9e-fe2096fedd57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6d1c11da-7794-43bd-b9d3-8b294341949f req-88755fcb-43da-4c9c-ba9e-fe2096fedd57 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6d1c11da-7794-43bd-b9d3-8b294341949f req-88755fcb-43da-4c9c-ba9e-fe2096fedd57 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:17 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-6d1c11da-7794-43bd-b9d3-8b294341949f req-88755fcb-43da-4c9c-ba9e-fe2096fedd57 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:17 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-6d1c11da-7794-43bd-b9d3-8b294341949f req-88755fcb-43da-4c9c-ba9e-fe2096fedd57 service nova] Creating event network-changed:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:21:17 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-6d1c11da-7794-43bd-b9d3-8b294341949f req-88755fcb-43da-4c9c-ba9e-fe2096fedd57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039440 Apr 18 20:21:17 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 142/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:21:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell0:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:17 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:17 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-d3e014ba-23db-411a-b165-e9f10544ec19 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a/ips" status: 200 len: 107 microversion: 2.1 time: 0.044606 Apr 18 20:21:17 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 136/412] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:21:17 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a/ips => generated 107 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:18 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:21:18 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-55111b5b-3700-47ae-82e8-97b284194e5a tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 204 len: 0 microversion: 2.1 time: 0.113932 Apr 18 20:21:18 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 135/413] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:21:18 2023] DELETE /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:18 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:19 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4859711fcdef4d91ae9caff4bacc85fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3da3c99e5d684aab877826bdbf471e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:21:19 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-06ad7c5f-04e0-45ee-b17f-10998cfa8e61 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 200 len: 1670 microversion: 2.1 time: 0.203447 Apr 18 20:21:19 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 143/414] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:21:18 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 1670 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:21:19 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "name": "network-vif-unplugged", "status": "completed", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}, {"server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "name": "network-vif-plugged", "status": "completed", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:21:19 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:19 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:19 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:19 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] Creating event network-vif-unplugged:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:21:19 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] Creating event network-vif-plugged:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:21:19 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-bcd2969b-2b59-4ca3-afd6-ad6f74035cdd req-f53e0d6d-7a04-4ac7-b1b8-d89dd397a3e7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.027748 Apr 18 20:21:19 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 137/415] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:21:19 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:21 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-76a6f4f2-d1c3-47b5-b24d-4e5b80583890 req-4a3b2850-5e15-44c4-a6fb-9113c904049a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d112726-63d9-4f49-a6d8-d5f14b4cd89a", "name": "network-vif-deleted", "tag": "eadcc0aa-c5c3-40a9-ae82-627e48b40386"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:21:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-76a6f4f2-d1c3-47b5-b24d-4e5b80583890 req-4a3b2850-5e15-44c4-a6fb-9113c904049a service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-76a6f4f2-d1c3-47b5-b24d-4e5b80583890 req-4a3b2850-5e15-44c4-a6fb-9113c904049a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:21 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-76a6f4f2-d1c3-47b5-b24d-4e5b80583890 req-4a3b2850-5e15-44c4-a6fb-9113c904049a service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-76a6f4f2-d1c3-47b5-b24d-4e5b80583890 req-4a3b2850-5e15-44c4-a6fb-9113c904049a service nova] Creating event network-vif-deleted:eadcc0aa-c5c3-40a9-ae82-627e48b40386 for instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a on user Apr 18 20:21:21 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-76a6f4f2-d1c3-47b5-b24d-4e5b80583890 req-4a3b2850-5e15-44c4-a6fb-9113c904049a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047207 Apr 18 20:21:21 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 136/416] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:21:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=8 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:30 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:21:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4e999bd7-42e9-4ba9-87d9-0f59c250a1d3 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1493 microversion: 2.1 time: 0.225675 Apr 18 20:21:30 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 144/417] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:21:30 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1493 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:21:49 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e46bfff374817aa1b04d614b83a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2ead7add0445e6867d53dd4b883f5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:21:49 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-b8133946-49a4-4788-8e83-914b713e35e7 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6" status: 200 len: 1565 microversion: 2.1 time: 0.214760 Apr 18 20:21:49 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 138/418] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:21:49 2023] GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 => generated 1565 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:09 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a HTTP/1.1 Apr 18 20:22:09 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:22:09 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:22:09 user devstack@n-api.service[61422]: Connection: close Apr 18 20:22:09 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:22:09 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:22:09 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:22:09 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:22:09 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:09 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:09 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:09 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:22:09 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:22:09 user devstack@n-api.service[61422]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:09 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:09 user devstack@n-api.service[61422]: method: > Apr 18 20:22:09 user devstack@n-api.service[61422]: exception: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:09 user devstack@n-api.service[61422]: action_args: {'id': '7d112726-63d9-4f49-a6d8-d5f14b4cd89a'} Apr 18 20:22:09 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:09 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:09 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:09 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-1a0e336e-d6ce-45d8-992f-df597ada3b97 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 404 len: 111 microversion: 2.1 time: 0.043905 Apr 18 20:22:09 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 137/419] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:09 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:09 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-a4661538-e64f-4a39-8e7e-6163a7e68c45 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '.version_select at 0x7fb7737c5480>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:09 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:09 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:09 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-a4661538-e64f-4a39-8e7e-6163a7e68c45 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517828598" status: 202 len: 0 microversion: 2.1 time: 0.027248 Apr 18 20:22:09 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 145/420] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 20:22:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1517828598 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=6 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:10 user devstack@n-api.service[61421]: request: DELETE /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a HTTP/1.1 Apr 18 20:22:10 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:22:10 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:22:10 user devstack@n-api.service[61421]: Connection: close Apr 18 20:22:10 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:22:10 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:22:10 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:22:10 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:22:10 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61421]: method: > Apr 18 20:22:10 user devstack@n-api.service[61421]: exception: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: action_args: {'id': '7d112726-63d9-4f49-a6d8-d5f14b4cd89a'} Apr 18 20:22:10 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:10 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-5158d92f-30e1-4c1a-9288-80da1e7a1754 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 404 len: 111 microversion: 2.1 time: 0.032528 Apr 18 20:22:10 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 139/421] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:22:10 2023] DELETE /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 7d112726-63d9-4f49-a6d8-d5f14b4cd89a] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:10 user devstack@n-api.service[61422]: request: GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a HTTP/1.1 Apr 18 20:22:10 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:22:10 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:22:10 user devstack@n-api.service[61422]: Connection: close Apr 18 20:22:10 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:22:10 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:22:10 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:22:10 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:22:10 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61422]: method: > Apr 18 20:22:10 user devstack@n-api.service[61422]: exception: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: action_args: {'id': '7d112726-63d9-4f49-a6d8-d5f14b4cd89a'} Apr 18 20:22:10 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 7d112726-63d9-4f49-a6d8-d5f14b4cd89a could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-eecd4265-265e-471f-b90f-7f82e82b3d99 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a" status: 404 len: 111 microversion: 2.1 time: 0.032145 Apr 18 20:22:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 138/422] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:10 2023] GET /compute/v2.1/servers/7d112726-63d9-4f49-a6d8-d5f14b4cd89a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:10 user devstack@n-api.service[61420]: request: DELETE /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 HTTP/1.1 Apr 18 20:22:10 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:22:10 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:22:10 user devstack@n-api.service[61420]: Connection: close Apr 18 20:22:10 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:22:10 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:22:10 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:22:10 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:22:10 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61420]: method: > Apr 18 20:22:10 user devstack@n-api.service[61420]: exception: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: action_args: {'id': '17a771cf-a0fc-4385-b1d2-f98f7c2bdff0'} Apr 18 20:22:10 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:10 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-e07b05db-ec5e-4dc2-a9ad-f5997d7535e6 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 404 len: 111 microversion: 2.1 time: 0.036836 Apr 18 20:22:10 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 146/423] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:22:10 2023] DELETE /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:10 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 HTTP/1.1 Apr 18 20:22:10 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:22:10 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:22:10 user devstack@n-api.service[61421]: Connection: close Apr 18 20:22:10 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:22:10 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:22:10 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:22:10 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:22:10 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:10 user devstack@n-api.service[61421]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61421]: method: > Apr 18 20:22:10 user devstack@n-api.service[61421]: exception: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: action_args: {'id': '17a771cf-a0fc-4385-b1d2-f98f7c2bdff0'} Apr 18 20:22:10 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:10 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-35422d4c-6e5f-4c76-94e3-c3a977c10ea9 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0" status: 404 len: 111 microversion: 2.1 time: 0.026391 Apr 18 20:22:10 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 140/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:10 2023] GET /compute/v2.1/servers/17a771cf-a0fc-4385-b1d2-f98f7c2bdff0 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:10 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 HTTP/1.1 Apr 18 20:22:10 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:22:10 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:22:10 user devstack@n-api.service[61422]: Connection: close Apr 18 20:22:10 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:22:10 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:22:10 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:22:10 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:22:10 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:10 user devstack@n-api.service[61422]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61422]: method: > Apr 18 20:22:10 user devstack@n-api.service[61422]: exception: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: action_args: {'id': '2e30921f-c93e-4d70-9742-4ff289d0dfc3'} Apr 18 20:22:10 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:10 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-7a2a3597-50dc-4a9e-872b-6d0c0e44ae18 tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 404 len: 111 microversion: 2.1 time: 0.028709 Apr 18 20:22:10 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 139/425] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:22:10 2023] DELETE /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] [instance: 2e30921f-c93e-4d70-9742-4ff289d0dfc3] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:10 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] HTTP exception thrown: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Request method failure captured: Apr 18 20:22:10 user devstack@n-api.service[61420]: request: GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 HTTP/1.1 Apr 18 20:22:10 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:22:10 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:22:10 user devstack@n-api.service[61420]: Connection: close Apr 18 20:22:10 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:22:10 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:22:10 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:22:10 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:22:10 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvn8ncTbqPpgy2dQZX0YWVVm_S08j0XL9OYeMvGPBse2SRNuAqi9ge9P1Aoo-Zq2XMSpa8lz-5qRX-zehRM9K-90v_kkTru74c1uefjVQ6QoNqcqlWMCUA0QJhkDQtL9beMgZ1lj29O87dfaslYk09yR8aeAc8fh-7Te54-z7M9dIXc Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Project-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3da3c99e5d684aab877826bdbf471e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3da3c99e5d684aab877826bdbf471e3f"}]}] Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Tenant: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Tenant-Id: 3da3c99e5d684aab877826bdbf471e3f Apr 18 20:22:10 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2030574995 Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Id: 4859711fcdef4d91ae9caff4bacc85fe Apr 18 20:22:10 user devstack@n-api.service[61420]: X-User-Name: tempest-AttachVolumeNegativeTest-2030574995-project-member Apr 18 20:22:10 user devstack@n-api.service[61420]: method: > Apr 18 20:22:10 user devstack@n-api.service[61420]: exception: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: action_args: {'id': '2e30921f-c93e-4d70-9742-4ff289d0dfc3'} Apr 18 20:22:10 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. Apr 18 20:22:10 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:22:10 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] Returning 404 to user: Instance 2e30921f-c93e-4d70-9742-4ff289d0dfc3 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:10 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-15765e02-4bbc-458e-9d6a-4443880d17fa tempest-AttachVolumeNegativeTest-2030574995 tempest-AttachVolumeNegativeTest-2030574995-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3" status: 404 len: 111 microversion: 2.1 time: 0.028004 Apr 18 20:22:10 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 147/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:10 2023] GET /compute/v2.1/servers/2e30921f-c93e-4d70-9742-4ff289d0dfc3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:14 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-27a3d4b5-8e50-474a-b08c-3b0482e2405d tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Action: 'create', calling method: .version_select at 0x7fb773ab16c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1574175714"}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:22:15 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-27a3d4b5-8e50-474a-b08c-3b0482e2405d tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.473268 Apr 18 20:22:15 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 141/427] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 20:22:14 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 475 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 20:22:15 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e62a3148-66cb-4ed5-8401-2df2c5b80adb tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Calling method '.version_select at 0x7fb77389bc70>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:15 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e62a3148-66cb-4ed5-8401-2df2c5b80adb tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6" status: 200 len: 342 microversion: 2.1 time: 0.051026 Apr 18 20:22:15 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 140/428] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:22:15 2023] GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 => generated 342 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:22:16 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-159038cd-ff49-42d3-b78d-4e44a516b8c4 tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Calling method '.version_select at 0x7fb7737c6170>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:16 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-159038cd-ff49-42d3-b78d-4e44a516b8c4 tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6" status: 200 len: 342 microversion: 2.1 time: 0.063957 Apr 18 20:22:16 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 148/429] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:22:16 2023] GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 => generated 342 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:22:16 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-7e9e230e-87f6-45a5-b1db-11ac6a805fcd tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Calling method '.version_select at 0x7fb773af5b40>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:16 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-7e9e230e-87f6-45a5-b1db-11ac6a805fcd tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6" status: 202 len: 0 microversion: 2.1 time: 0.143930 Apr 18 20:22:16 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 142/430] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:22:16 2023] DELETE /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:22:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4d9c9d93-2a0a-4d41-85bc-6a76c4645c6f tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Calling method '.version_select at 0x7fb7738dd750>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-4d9c9d93-2a0a-4d41-85bc-6a76c4645c6f tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] HTTP exception thrown: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. Apr 18 20:22:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4d9c9d93-2a0a-4d41-85bc-6a76c4645c6f tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Request method failure captured: Apr 18 20:22:16 user devstack@n-api.service[61422]: request: GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 HTTP/1.1 Apr 18 20:22:16 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:22:16 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:22:16 user devstack@n-api.service[61422]: Connection: close Apr 18 20:22:16 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:22:16 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:22:16 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:22:16 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:22:16 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvv2jp1FapS6xNtQhFmznYj34SX08qpZJdu4qmYLD2v8C2wZOwT4YCNJ-yvxp7iCk5dgT96yKm-8PYKE48Crtc9dH-frzRfWwtuL_aaeYD7Wmv0Cq5eRQgggwKDZaxiMMXZjj4CV9EHOVDPpdrMOn6lg4YR5RUNJcN0bWSB47T4Io3U Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Project-Id: 705e3b2f99394747be425c33e7011e63 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-388826995 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/705e3b2f99394747be425c33e7011e63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/705e3b2f99394747be425c33e7011e63"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/705e3b2f99394747be425c33e7011e63"}]}] Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesSnapshotsTestJSON-388826995 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Tenant-Id: 705e3b2f99394747be425c33e7011e63 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-388826995 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-User: tempest-VolumesSnapshotsTestJSON-388826995-project-member Apr 18 20:22:16 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:22:16 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:22:16 user devstack@n-api.service[61422]: X-User-Id: 3a7191885e264aa4adbe56f06e24c144 Apr 18 20:22:16 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesSnapshotsTestJSON-388826995-project-member Apr 18 20:22:16 user devstack@n-api.service[61422]: method: Apr 18 20:22:16 user devstack@n-api.service[61422]: exception: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. Apr 18 20:22:16 user devstack@n-api.service[61422]: action_args: {'id': '8abcaf5f-f5d9-4576-a0e7-c5847a537dc6'} Apr 18 20:22:16 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. (HTTP 404) (Request-ID: req-10ba0308-c2df-472b-84a1-278cc1abb7c5) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. Apr 18 20:22:16 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:22:16 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-4d9c9d93-2a0a-4d41-85bc-6a76c4645c6f tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] Returning 404 to user: Volume 8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:22:16 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-4d9c9d93-2a0a-4d41-85bc-6a76c4645c6f tempest-VolumesSnapshotsTestJSON-388826995 tempest-VolumesSnapshotsTestJSON-388826995-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6" status: 404 len: 109 microversion: 2.1 time: 0.033334 Apr 18 20:22:16 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 141/431] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:22:16 2023] GET /compute/v2.1/os-volumes/8abcaf5f-f5d9-4576-a0e7-c5847a537dc6 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=4 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:30 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:22:30 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-bf744242-c4e0-4e41-8774-10fc3a37218b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1493 microversion: 2.1 time: 0.219803 Apr 18 20:22:30 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 149/432] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:30 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1493 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:49 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:50 user devstack@n-api.service[61421]: DEBUG nova.policy [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e46bfff374817aa1b04d614b83a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2ead7add0445e6867d53dd4b883f5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61421) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:22:50 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-4c6cf77f-4a00-4b5d-83a2-b99496ae6052 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6" status: 200 len: 1565 microversion: 2.1 time: 0.219131 Apr 18 20:22:50 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 143/433] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:49 2023] GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 => generated 1565 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=6 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:51 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:22:51 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-41018514-684a-4722-aa4a-92133ebc1370 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6" status: 204 len: 0 microversion: 2.1 time: 0.113916 Apr 18 20:22:51 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 142/434] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:22:51 2023] DELETE /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:51 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa0e46bfff374817aa1b04d614b83a60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2ead7add0445e6867d53dd4b883f5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:22:51 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-f989e56d-2489-4bd9-b1eb-429852ed6b26 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6" status: 200 len: 1571 microversion: 2.1 time: 0.197349 Apr 18 20:22:51 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 150/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:22:51 2023] GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 => generated 1571 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:22:52 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-f2b3b0a9-11e3-4abf-8f77-b1981f9f710a req-ad95bef3-bb11-473d-bdaf-6883dd835433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3a3b5e-5853-492a-b48a-1819643934b6", "name": "network-vif-unplugged", "status": "completed", "tag": "b82e725d-e7be-4b7f-bb40-d146e98c5416"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:22:52 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f2b3b0a9-11e3-4abf-8f77-b1981f9f710a req-ad95bef3-bb11-473d-bdaf-6883dd835433 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:52 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f2b3b0a9-11e3-4abf-8f77-b1981f9f710a req-ad95bef3-bb11-473d-bdaf-6883dd835433 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:52 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-f2b3b0a9-11e3-4abf-8f77-b1981f9f710a req-ad95bef3-bb11-473d-bdaf-6883dd835433 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:52 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-f2b3b0a9-11e3-4abf-8f77-b1981f9f710a req-ad95bef3-bb11-473d-bdaf-6883dd835433 service nova] Creating event network-vif-unplugged:b82e725d-e7be-4b7f-bb40-d146e98c5416 for instance 4e3a3b5e-5853-492a-b48a-1819643934b6 on user Apr 18 20:22:52 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-f2b3b0a9-11e3-4abf-8f77-b1981f9f710a req-ad95bef3-bb11-473d-bdaf-6883dd835433 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033922 Apr 18 20:22:52 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 144/436] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:22:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:22:54 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e3a3b5e-5853-492a-b48a-1819643934b6", "name": "network-vif-plugged", "status": "completed", "tag": "b82e725d-e7be-4b7f-bb40-d146e98c5416"}, {"server_uuid": "4e3a3b5e-5853-492a-b48a-1819643934b6", "name": "network-vif-deleted", "tag": "b82e725d-e7be-4b7f-bb40-d146e98c5416"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:22:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:22:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:22:54 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:22:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] Creating event network-vif-plugged:b82e725d-e7be-4b7f-bb40-d146e98c5416 for instance 4e3a3b5e-5853-492a-b48a-1819643934b6 on user Apr 18 20:22:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] Creating event network-vif-deleted:b82e725d-e7be-4b7f-bb40-d146e98c5416 for instance 4e3a3b5e-5853-492a-b48a-1819643934b6 on user Apr 18 20:22:54 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-bbaacb88-cc06-4ba8-9b6f-db055dd6e8dc req-ec8f690e-fe29-4e19-b5a9-c23b0309273c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031512 Apr 18 20:22:54 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 143/437] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:22:54 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:23:32 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:23:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-5cc01104-930c-483b-b7ac-396d1aaf6402 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1493 microversion: 2.1 time: 0.218935 Apr 18 20:23:32 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 151/438] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:23:32 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1493 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=8 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] [instance: 4e3a3b5e-5853-492a-b48a-1819643934b6] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:23:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] HTTP exception thrown: Instance 4e3a3b5e-5853-492a-b48a-1819643934b6 could not be found. Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Request method failure captured: Apr 18 20:23:42 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 HTTP/1.1 Apr 18 20:23:42 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:23:42 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:23:42 user devstack@n-api.service[61421]: Connection: close Apr 18 20:23:42 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:23:42 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:23:42 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:23:42 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:23:42 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvujxdBGrLsHPBzWXOlrg4XB4t1Jb_hpt_pGlND5hw2m0HgMfMJ53Ljndb0F0eW_dYL-47SILc_opt7ByClmyByFeHxbL_0SmoZaKDRtkRE6VeH2gYD7zbhqIwdOUd03dfD8ze3pxnDZVOXqa9LxR3qvutNjrbgKRvIKQRAUwfqr4aQ Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Project-Id: 9d2ead7add0445e6867d53dd4b883f5b Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1197375983 Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d2ead7add0445e6867d53dd4b883f5b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9d2ead7add0445e6867d53dd4b883f5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9d2ead7add0445e6867d53dd4b883f5b"}]}] Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Tenant: tempest-SnapshotDataIntegrityTests-1197375983 Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Tenant-Id: 9d2ead7add0445e6867d53dd4b883f5b Apr 18 20:23:42 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1197375983 Apr 18 20:23:42 user devstack@n-api.service[61421]: X-User: tempest-SnapshotDataIntegrityTests-1197375983-project-member Apr 18 20:23:42 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:23:42 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:23:42 user devstack@n-api.service[61421]: X-User-Id: aa0e46bfff374817aa1b04d614b83a60 Apr 18 20:23:42 user devstack@n-api.service[61421]: X-User-Name: tempest-SnapshotDataIntegrityTests-1197375983-project-member Apr 18 20:23:42 user devstack@n-api.service[61421]: method: > Apr 18 20:23:42 user devstack@n-api.service[61421]: exception: Instance 4e3a3b5e-5853-492a-b48a-1819643934b6 could not be found. Apr 18 20:23:42 user devstack@n-api.service[61421]: action_args: {'id': '4e3a3b5e-5853-492a-b48a-1819643934b6'} Apr 18 20:23:42 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e3a3b5e-5853-492a-b48a-1819643934b6 could not be found. Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e3a3b5e-5853-492a-b48a-1819643934b6 could not be found. Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e3a3b5e-5853-492a-b48a-1819643934b6 could not be found. Apr 18 20:23:42 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:23:42 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Returning 404 to user: Instance 4e3a3b5e-5853-492a-b48a-1819643934b6 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:23:42 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-a31f534e-5a57-4aa9-a685-1e6be74aebab tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6" status: 404 len: 111 microversion: 2.1 time: 0.038197 Apr 18 20:23:42 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 145/439] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:23:42 2023] GET /compute/v2.1/servers/4e3a3b5e-5853-492a-b48a-1819643934b6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:23:42 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:23:42 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:23:42 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c0d6b675-6df4-47c3-9501-a1b9e26f7866 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] Calling method '.version_select at 0x7fb7738dce50>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:23:42 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c0d6b675-6df4-47c3-9501-a1b9e26f7866 tempest-SnapshotDataIntegrityTests-1197375983 tempest-SnapshotDataIntegrityTests-1197375983-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-636534463" status: 202 len: 0 microversion: 2.1 time: 0.028816 Apr 18 20:23:42 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 144/440] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:23:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-636534463 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=2 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] HTTP exception thrown: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Request method failure captured: Apr 18 20:24:32 user devstack@n-api.service[61420]: request: DELETE /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 HTTP/1.1 Apr 18 20:24:32 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:24:32 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:24:32 user devstack@n-api.service[61420]: Connection: close Apr 18 20:24:32 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:24:32 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:24:32 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:24:32 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:24:32 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvp6_lVeLNtIHk4InqAStHg8-D73cDk8h8pa7Zo4i9HN72thQPlszg8PRxvt3tLnSt5sRha44RCrrusDiJA_TCaaGO01HHTdnJhKO6Oo88ogaA63NjvbMPPJX0F8QZgAYM3YHmKYJ6MImTWvWP2RyEmcDhmRe2dFsMB50RS-O2J5Tk8 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Project-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Project-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b332619e85294fc182a0e341f353d0c3"}]}] Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Tenant: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Tenant-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:24:32 user devstack@n-api.service[61420]: X-User: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:24:32 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:24:32 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:24:32 user devstack@n-api.service[61420]: X-User-Id: 79a57c819f0f4dd4a36eadbc002418db Apr 18 20:24:32 user devstack@n-api.service[61420]: X-User-Name: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:24:32 user devstack@n-api.service[61420]: method: > Apr 18 20:24:32 user devstack@n-api.service[61420]: exception: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61420]: action_args: {'id': 'db39cb17-b71e-4aef-a854-cd1da1f9ab05'} Apr 18 20:24:32 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Returning 404 to user: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:24:32 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-4a6d910a-50c6-416c-8eb5-6d4adcfd208b tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 404 len: 111 microversion: 2.1 time: 0.041857 Apr 18 20:24:32 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 152/441] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:24:32 2023] DELETE /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: db39cb17-b71e-4aef-a854-cd1da1f9ab05] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=2 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] HTTP exception thrown: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Request method failure captured: Apr 18 20:24:32 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 HTTP/1.1 Apr 18 20:24:32 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:24:32 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:24:32 user devstack@n-api.service[61421]: Connection: close Apr 18 20:24:32 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:24:32 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:24:32 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:24:32 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:24:32 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvp6_lVeLNtIHk4InqAStHg8-D73cDk8h8pa7Zo4i9HN72thQPlszg8PRxvt3tLnSt5sRha44RCrrusDiJA_TCaaGO01HHTdnJhKO6Oo88ogaA63NjvbMPPJX0F8QZgAYM3YHmKYJ6MImTWvWP2RyEmcDhmRe2dFsMB50RS-O2J5Tk8 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Project-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Project-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b332619e85294fc182a0e341f353d0c3"}]}] Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Tenant: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Tenant-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:24:32 user devstack@n-api.service[61421]: X-User: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:24:32 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:24:32 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:24:32 user devstack@n-api.service[61421]: X-User-Id: 79a57c819f0f4dd4a36eadbc002418db Apr 18 20:24:32 user devstack@n-api.service[61421]: X-User-Name: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:24:32 user devstack@n-api.service[61421]: method: > Apr 18 20:24:32 user devstack@n-api.service[61421]: exception: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61421]: action_args: {'id': 'db39cb17-b71e-4aef-a854-cd1da1f9ab05'} Apr 18 20:24:32 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. Apr 18 20:24:32 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:24:32 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Returning 404 to user: Instance db39cb17-b71e-4aef-a854-cd1da1f9ab05 could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:24:32 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-27a6b580-dc88-4e2c-a870-025b1e66844a tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05" status: 404 len: 111 microversion: 2.1 time: 0.034075 Apr 18 20:24:32 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 146/442] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:24:32 2023] GET /compute/v2.1/servers/db39cb17-b71e-4aef-a854-cd1da1f9ab05 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61422) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:32 user devstack@n-api.service[61422]: DEBUG nova.compute.api [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Going to try to terminate instance {{(pid=61422) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:24:33 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-e5884e70-4050-4223-8150-957d2e9d1abe tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 204 len: 0 microversion: 2.1 time: 0.117539 Apr 18 20:24:33 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 145/443] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:24:32 2023] DELETE /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG nova.compute.api [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61420) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:33 user devstack@n-api.service[61420]: DEBUG nova.policy [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79a57c819f0f4dd4a36eadbc002418db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b332619e85294fc182a0e341f353d0c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61420) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:24:33 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-473a6aee-7db2-4e3f-9386-4954cc976e04 tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 200 len: 1499 microversion: 2.1 time: 0.285850 Apr 18 20:24:33 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 153/444] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:24:33 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 1499 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:24:33 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [req-8973e511-04bb-4e1b-9a94-6ce862eabc48 req-345b8b61-8d56-478b-938b-ef14a10d8c7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ea55b-7619-4364-ad4f-0d590c3a5d3e", "name": "network-vif-unplugged", "status": "completed", "tag": "0e32d5d6-4e79-4229-884f-105ee7c1d38d"}]} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:24:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8973e511-04bb-4e1b-9a94-6ce862eabc48 req-345b8b61-8d56-478b-938b-ef14a10d8c7c service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8973e511-04bb-4e1b-9a94-6ce862eabc48 req-345b8b61-8d56-478b-938b-ef14a10d8c7c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:33 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [req-8973e511-04bb-4e1b-9a94-6ce862eabc48 req-345b8b61-8d56-478b-938b-ef14a10d8c7c service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:33 user devstack@n-api.service[61421]: INFO nova.api.openstack.compute.server_external_events [req-8973e511-04bb-4e1b-9a94-6ce862eabc48 req-345b8b61-8d56-478b-938b-ef14a10d8c7c service nova] Creating event network-vif-unplugged:0e32d5d6-4e79-4229-884f-105ee7c1d38d for instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e on user Apr 18 20:24:33 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [req-8973e511-04bb-4e1b-9a94-6ce862eabc48 req-345b8b61-8d56-478b-938b-ef14a10d8c7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.195447 Apr 18 20:24:33 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 147/445] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:24:33 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:24:34 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [req-30b6f1cb-9835-478c-87fb-fa5f722d6664 req-424c76e2-3659-4d52-9c0b-0254b9b31e35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ea55b-7619-4364-ad4f-0d590c3a5d3e", "name": "network-vif-deleted", "tag": "0e32d5d6-4e79-4229-884f-105ee7c1d38d"}]} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:24:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-30b6f1cb-9835-478c-87fb-fa5f722d6664 req-424c76e2-3659-4d52-9c0b-0254b9b31e35 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-30b6f1cb-9835-478c-87fb-fa5f722d6664 req-424c76e2-3659-4d52-9c0b-0254b9b31e35 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:34 user devstack@n-api.service[61422]: DEBUG oslo_concurrency.lockutils [req-30b6f1cb-9835-478c-87fb-fa5f722d6664 req-424c76e2-3659-4d52-9c0b-0254b9b31e35 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61422) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.compute.server_external_events [req-30b6f1cb-9835-478c-87fb-fa5f722d6664 req-424c76e2-3659-4d52-9c0b-0254b9b31e35 service nova] Creating event network-vif-deleted:0e32d5d6-4e79-4229-884f-105ee7c1d38d for instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e on user Apr 18 20:24:34 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [req-30b6f1cb-9835-478c-87fb-fa5f722d6664 req-424c76e2-3659-4d52-9c0b-0254b9b31e35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027091 Apr 18 20:24:34 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 146/446] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:24:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:24:35 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [req-b7bc4b40-efc9-40e8-ad71-020c10d8c357 req-b2feccb2-48a3-4c9f-ab40-c52708e6fe60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "430ea55b-7619-4364-ad4f-0d590c3a5d3e", "name": "network-vif-plugged", "status": "completed", "tag": "0e32d5d6-4e79-4229-884f-105ee7c1d38d"}]} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:24:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b7bc4b40-efc9-40e8-ad71-020c10d8c357 req-b2feccb2-48a3-4c9f-ab40-c52708e6fe60 service nova] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:24:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b7bc4b40-efc9-40e8-ad71-020c10d8c357 req-b2feccb2-48a3-4c9f-ab40-c52708e6fe60 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:24:35 user devstack@n-api.service[61420]: DEBUG oslo_concurrency.lockutils [req-b7bc4b40-efc9-40e8-ad71-020c10d8c357 req-b2feccb2-48a3-4c9f-ab40-c52708e6fe60 service nova] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61420) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:24:35 user devstack@n-api.service[61420]: INFO nova.api.openstack.compute.server_external_events [req-b7bc4b40-efc9-40e8-ad71-020c10d8c357 req-b2feccb2-48a3-4c9f-ab40-c52708e6fe60 service nova] Creating event network-vif-plugged:0e32d5d6-4e79-4229-884f-105ee7c1d38d for instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e on user Apr 18 20:24:35 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [req-b7bc4b40-efc9-40e8-ad71-020c10d8c357 req-b2feccb2-48a3-4c9f-ab40-c52708e6fe60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029311 Apr 18 20:24:35 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 154/447] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:24:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_api:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG dbcounter [-] [61421] Writing DB stats nova_cell1:SELECT=4 {{(pid=61421) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Calling method '>' {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG nova.compute.api [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] [instance: 430ea55b-7619-4364-ad4f-0d590c3a5d3e] Fetching instance by UUID {{(pid=61421) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Acquiring lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG oslo_concurrency.lockutils [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Lock "285bd6ea-7144-4ccd-a44d-fb1de459fade" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61421) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:25:23 user devstack@n-api.service[61421]: INFO nova.api.openstack.wsgi [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] HTTP exception thrown: Instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e could not be found. Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Request method failure captured: Apr 18 20:25:23 user devstack@n-api.service[61421]: request: GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e HTTP/1.1 Apr 18 20:25:23 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:25:23 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:25:23 user devstack@n-api.service[61421]: Connection: close Apr 18 20:25:23 user devstack@n-api.service[61421]: Content-Length: 0 Apr 18 20:25:23 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:25:23 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:25:23 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:25:23 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvp6_lVeLNtIHk4InqAStHg8-D73cDk8h8pa7Zo4i9HN72thQPlszg8PRxvt3tLnSt5sRha44RCrrusDiJA_TCaaGO01HHTdnJhKO6Oo88ogaA63NjvbMPPJX0F8QZgAYM3YHmKYJ6MImTWvWP2RyEmcDhmRe2dFsMB50RS-O2J5Tk8 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Project-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Project-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b332619e85294fc182a0e341f353d0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b332619e85294fc182a0e341f353d0c3"}]}] Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Tenant: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Tenant-Id: b332619e85294fc182a0e341f353d0c3 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-ServersNegativeTestJSON-777747339 Apr 18 20:25:23 user devstack@n-api.service[61421]: X-User: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:25:23 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:25:23 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:25:23 user devstack@n-api.service[61421]: X-User-Id: 79a57c819f0f4dd4a36eadbc002418db Apr 18 20:25:23 user devstack@n-api.service[61421]: X-User-Name: tempest-ServersNegativeTestJSON-777747339-project-member Apr 18 20:25:23 user devstack@n-api.service[61421]: method: > Apr 18 20:25:23 user devstack@n-api.service[61421]: exception: Instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e could not be found. Apr 18 20:25:23 user devstack@n-api.service[61421]: action_args: {'id': '430ea55b-7619-4364-ad4f-0d590c3a5d3e'} Apr 18 20:25:23 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e could not be found. Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e could not be found. Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e could not be found. Apr 18 20:25:23 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:23 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] Returning 404 to user: Instance 430ea55b-7619-4364-ad4f-0d590c3a5d3e could not be found. {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:23 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-9f110122-c63a-4b42-af97-71418f810eec tempest-ServersNegativeTestJSON-777747339 tempest-ServersNegativeTestJSON-777747339-project-member] 10.0.0.210 "GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e" status: 404 len: 111 microversion: 2.1 time: 0.033315 Apr 18 20:25:23 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 148/448] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:25:23 2023] GET /compute/v2.1/servers/430ea55b-7619-4364-ad4f-0d590c3a5d3e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:25:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:25:27 user devstack@n-api.service[61422]: DEBUG dbcounter [-] [61422] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61422) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:25:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-55c413d0-1091-4c7d-9691-c6d5ee5610a1 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Action: 'create', calling method: .version_select at 0x7fb77389bac0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1998824699", "metadata": {"Type": "work"}}} {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:25:27 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-55c413d0-1091-4c7d-9691-c6d5ee5610a1 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Request method failure captured: Apr 18 20:25:27 user devstack@n-api.service[61422]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 20:25:27 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:25:27 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:25:27 user devstack@n-api.service[61422]: Connection: close Apr 18 20:25:27 user devstack@n-api.service[61422]: Content-Length: 122 Apr 18 20:25:27 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:25:27 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:25:27 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:25:27 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvy3J2iCm47OHzhPNDv2CpIxySmBRr4rGdoxjR_giCKVdx5UVUly8xmq8eL1535wdNW1OTUP5dUC7lyDO3FpxKoFdqKyX6iOxOnndqrMuz8M8QYWdjfW1wNLouqRrYPnq6psk7qMaCyc8xE3DWAIm9-NSPVymGH6Y86Vk7p2x5UOrYU Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Project-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:25:27 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d98e1e598caf4abea7d0748bfa2e0f3b"}]}] Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Id: 07881abb89354c5baaebad17128c46dd Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61422]: Apr 18 20:25:28 user devstack@n-api.service[61422]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1998824699", "metadata": {"Type": "work"}}} Apr 18 20:25:28 user devstack@n-api.service[61422]: method: Apr 18 20:25:28 user devstack@n-api.service[61422]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61422]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1998824699', 'metadata': {'Type': 'work'}}}} Apr 18 20:25:28 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise error Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-55c413d0-1091-4c7d-9691-c6d5ee5610a1 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-55c413d0-1091-4c7d-9691-c6d5ee5610a1 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.173692 Apr 18 20:25:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 147/449] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:25:27 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_api:SELECT=6 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG dbcounter [-] [61420] Writing DB stats nova_cell1:SELECT=10 {{(pid=61420) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-b526625e-8251-4a7f-b6d3-f3d49932af92 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Action: 'create', calling method: .version_select at 0x7fb7737c6830>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1535291335", "metadata": {"Type": "work"}}} {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-b526625e-8251-4a7f-b6d3-f3d49932af92 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Request method failure captured: Apr 18 20:25:28 user devstack@n-api.service[61420]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 20:25:28 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:25:28 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:25:28 user devstack@n-api.service[61420]: Connection: close Apr 18 20:25:28 user devstack@n-api.service[61420]: Content-Length: 120 Apr 18 20:25:28 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:25:28 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:25:28 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:25:28 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvy3J2iCm47OHzhPNDv2CpIxySmBRr4rGdoxjR_giCKVdx5UVUly8xmq8eL1535wdNW1OTUP5dUC7lyDO3FpxKoFdqKyX6iOxOnndqrMuz8M8QYWdjfW1wNLouqRrYPnq6psk7qMaCyc8xE3DWAIm9-NSPVymGH6Y86Vk7p2x5UOrYU Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d98e1e598caf4abea7d0748bfa2e0f3b"}]}] Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Tenant: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Tenant-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Id: 07881abb89354c5baaebad17128c46dd Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Name: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61420]: Apr 18 20:25:28 user devstack@n-api.service[61420]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1535291335", "metadata": {"Type": "work"}}} Apr 18 20:25:28 user devstack@n-api.service[61420]: method: Apr 18 20:25:28 user devstack@n-api.service[61420]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 20:25:28 user devstack@n-api.service[61420]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1535291335', 'metadata': {'Type': 'work'}}}} Apr 18 20:25:28 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise error Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi '0' Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-b526625e-8251-4a7f-b6d3-f3d49932af92 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-b526625e-8251-4a7f-b6d3-f3d49932af92 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018330 Apr 18 20:25:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 155/450] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:25:28 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-f4a703e7-8244-458f-9230-04247d4da528 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Action: 'create', calling method: .version_select at 0x7fb773ab3400>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1185117589", "metadata": {"Type": "work"}}} {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:25:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-f4a703e7-8244-458f-9230-04247d4da528 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Request method failure captured: Apr 18 20:25:28 user devstack@n-api.service[61421]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 20:25:28 user devstack@n-api.service[61421]: Accept: application/json Apr 18 20:25:28 user devstack@n-api.service[61421]: Accept-Encoding: identity Apr 18 20:25:28 user devstack@n-api.service[61421]: Connection: close Apr 18 20:25:28 user devstack@n-api.service[61421]: Content-Length: 119 Apr 18 20:25:28 user devstack@n-api.service[61421]: Content-Type: application/json Apr 18 20:25:28 user devstack@n-api.service[61421]: Host: 10.0.0.210 Apr 18 20:25:28 user devstack@n-api.service[61421]: Openstack-System-Scope: None Apr 18 20:25:28 user devstack@n-api.service[61421]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Auth-Token: gAAAAABkPvy3J2iCm47OHzhPNDv2CpIxySmBRr4rGdoxjR_giCKVdx5UVUly8xmq8eL1535wdNW1OTUP5dUC7lyDO3FpxKoFdqKyX6iOxOnndqrMuz8M8QYWdjfW1wNLouqRrYPnq6psk7qMaCyc8xE3DWAIm9-NSPVymGH6Y86Vk7p2x5UOrYU Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Domain-Id: None Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Domain-Name: None Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Identity-Status: Confirmed Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Is-Admin-Project: True Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Project-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Project-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Project-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Project-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Role: member,reader Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Roles: member,reader Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d98e1e598caf4abea7d0748bfa2e0f3b"}]}] Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Tenant: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Tenant-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61421]: X-Tenant-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61421]: X-User: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61421]: X-User-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61421]: X-User-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61421]: X-User-Id: 07881abb89354c5baaebad17128c46dd Apr 18 20:25:28 user devstack@n-api.service[61421]: X-User-Name: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61421]: Apr 18 20:25:28 user devstack@n-api.service[61421]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1185117589", "metadata": {"Type": "work"}}} Apr 18 20:25:28 user devstack@n-api.service[61421]: method: Apr 18 20:25:28 user devstack@n-api.service[61421]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61421]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1185117589', 'metadata': {'Type': 'work'}}}} Apr 18 20:25:28 user devstack@n-api.service[61421]: {{(pid=61421) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise error Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi '' Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 20:25:28 user devstack@n-api.service[61421]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61421]: DEBUG nova.api.openstack.wsgi [None req-f4a703e7-8244-458f-9230-04247d4da528 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61421) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-f4a703e7-8244-458f-9230-04247d4da528 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011198 Apr 18 20:25:28 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 149/451] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:25:28 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-78552b35-1179-4a46-8441-9f03223b12bb tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Calling method '.version_select at 0x7fb7738dd510>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-78552b35-1179-4a46-8441-9f03223b12bb tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] HTTP exception thrown: Volume tempest-invalid-743458151 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-78552b35-1179-4a46-8441-9f03223b12bb tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Request method failure captured: Apr 18 20:25:28 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-743458151 HTTP/1.1 Apr 18 20:25:28 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:25:28 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:25:28 user devstack@n-api.service[61422]: Connection: close Apr 18 20:25:28 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:25:28 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:25:28 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:25:28 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:25:28 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvy3J2iCm47OHzhPNDv2CpIxySmBRr4rGdoxjR_giCKVdx5UVUly8xmq8eL1535wdNW1OTUP5dUC7lyDO3FpxKoFdqKyX6iOxOnndqrMuz8M8QYWdjfW1wNLouqRrYPnq6psk7qMaCyc8xE3DWAIm9-NSPVymGH6Y86Vk7p2x5UOrYU Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d98e1e598caf4abea7d0748bfa2e0f3b"}]}] Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Id: 07881abb89354c5baaebad17128c46dd Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61422]: method: Apr 18 20:25:28 user devstack@n-api.service[61422]: exception: Volume tempest-invalid-743458151 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: action_args: {'id': 'tempest-invalid-743458151'} Apr 18 20:25:28 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-743458151 could not be found. (HTTP 404) (Request-ID: req-5e92ecc7-f468-416b-b075-3a7df4aa5f3f) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-743458151 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-743458151 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-743458151 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-78552b35-1179-4a46-8441-9f03223b12bb tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Returning 404 to user: Volume tempest-invalid-743458151 could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-78552b35-1179-4a46-8441-9f03223b12bb tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-743458151" status: 404 len: 98 microversion: 2.1 time: 0.144767 Apr 18 20:25:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 148/452] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 20:25:28 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-743458151 => generated 98 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-11146f07-1ffc-4f60-b70c-0a244b14ac8b tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004711 Apr 18 20:25:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 156/453] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 20:25:28 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61421]: INFO nova.api.openstack.requestlog [None req-c10b6369-0135-4242-ac21-90c32e7ccb1e tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004186 Apr 18 20:25:28 user devstack@n-api.service[61421]: [pid: 61421|app: 0|req: 150/454] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 20:25:28 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c385c4da-1d11-4eae-ab18-a79dd4701db8 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Calling method '.version_select at 0x7fb77389bbe0>' {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.wsgi [None req-c385c4da-1d11-4eae-ab18-a79dd4701db8 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] HTTP exception thrown: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c385c4da-1d11-4eae-ab18-a79dd4701db8 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Request method failure captured: Apr 18 20:25:28 user devstack@n-api.service[61422]: request: DELETE /compute/v2.1/os-volumes/46017796-a08c-463b-8d56-17f321e45e5f HTTP/1.1 Apr 18 20:25:28 user devstack@n-api.service[61422]: Accept: application/json Apr 18 20:25:28 user devstack@n-api.service[61422]: Accept-Encoding: identity Apr 18 20:25:28 user devstack@n-api.service[61422]: Connection: close Apr 18 20:25:28 user devstack@n-api.service[61422]: Content-Length: 0 Apr 18 20:25:28 user devstack@n-api.service[61422]: Content-Type: application/json Apr 18 20:25:28 user devstack@n-api.service[61422]: Host: 10.0.0.210 Apr 18 20:25:28 user devstack@n-api.service[61422]: Openstack-System-Scope: None Apr 18 20:25:28 user devstack@n-api.service[61422]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Auth-Token: gAAAAABkPvy3J2iCm47OHzhPNDv2CpIxySmBRr4rGdoxjR_giCKVdx5UVUly8xmq8eL1535wdNW1OTUP5dUC7lyDO3FpxKoFdqKyX6iOxOnndqrMuz8M8QYWdjfW1wNLouqRrYPnq6psk7qMaCyc8xE3DWAIm9-NSPVymGH6Y86Vk7p2x5UOrYU Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Domain-Id: None Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Domain-Name: None Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Identity-Status: Confirmed Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Is-Admin-Project: True Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Project-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Role: member,reader Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Roles: member,reader Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d98e1e598caf4abea7d0748bfa2e0f3b"}]}] Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61422]: X-Tenant-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Id: 07881abb89354c5baaebad17128c46dd Apr 18 20:25:28 user devstack@n-api.service[61422]: X-User-Name: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61422]: method: Apr 18 20:25:28 user devstack@n-api.service[61422]: exception: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: action_args: {'id': '46017796-a08c-463b-8d56-17f321e45e5f'} Apr 18 20:25:28 user devstack@n-api.service[61422]: {{(pid=61422) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. (HTTP 404) (Request-ID: req-bdfc3a3c-6bf5-42ea-b53f-327307560961) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. Apr 18 20:25:28 user devstack@n-api.service[61422]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61422]: DEBUG nova.api.openstack.wsgi [None req-c385c4da-1d11-4eae-ab18-a79dd4701db8 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Returning 404 to user: Volume 46017796-a08c-463b-8d56-17f321e45e5f could not be found. {{(pid=61422) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:28 user devstack@n-api.service[61422]: INFO nova.api.openstack.requestlog [None req-c385c4da-1d11-4eae-ab18-a79dd4701db8 tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/46017796-a08c-463b-8d56-17f321e45e5f" status: 404 len: 109 microversion: 2.1 time: 0.047802 Apr 18 20:25:28 user devstack@n-api.service[61422]: [pid: 61422|app: 0|req: 149/455] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:25:28 2023] DELETE /compute/v2.1/os-volumes/46017796-a08c-463b-8d56-17f321e45e5f => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-fdd17cba-93fa-4294-8143-d65738ea827f tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Calling method '.version_select at 0x7fb7738ddc60>' {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:25:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.wsgi [None req-fdd17cba-93fa-4294-8143-d65738ea827f tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] HTTP exception thrown: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-fdd17cba-93fa-4294-8143-d65738ea827f tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Request method failure captured: Apr 18 20:25:28 user devstack@n-api.service[61420]: request: GET /compute/v2.1/os-volumes/5de97177-311a-4916-a5ec-31baa1a754b4 HTTP/1.1 Apr 18 20:25:28 user devstack@n-api.service[61420]: Accept: application/json Apr 18 20:25:28 user devstack@n-api.service[61420]: Accept-Encoding: identity Apr 18 20:25:28 user devstack@n-api.service[61420]: Connection: close Apr 18 20:25:28 user devstack@n-api.service[61420]: Content-Length: 0 Apr 18 20:25:28 user devstack@n-api.service[61420]: Content-Type: application/json Apr 18 20:25:28 user devstack@n-api.service[61420]: Host: 10.0.0.210 Apr 18 20:25:28 user devstack@n-api.service[61420]: Openstack-System-Scope: None Apr 18 20:25:28 user devstack@n-api.service[61420]: User-Agent: python-urllib3/1.26.15 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Auth-Token: gAAAAABkPvy3J2iCm47OHzhPNDv2CpIxySmBRr4rGdoxjR_giCKVdx5UVUly8xmq8eL1535wdNW1OTUP5dUC7lyDO3FpxKoFdqKyX6iOxOnndqrMuz8M8QYWdjfW1wNLouqRrYPnq6psk7qMaCyc8xE3DWAIm9-NSPVymGH6Y86Vk7p2x5UOrYU Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Domain-Id: None Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Domain-Name: None Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Identity-Status: Confirmed Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Is-Admin-Project: True Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Project-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Role: member,reader Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Roles: member,reader Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d98e1e598caf4abea7d0748bfa2e0f3b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d98e1e598caf4abea7d0748bfa2e0f3b"}]}] Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Tenant: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Tenant-Id: d98e1e598caf4abea7d0748bfa2e0f3b Apr 18 20:25:28 user devstack@n-api.service[61420]: X-Tenant-Name: tempest-VolumesNegativeTest-1359849480 Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Domain-Id: default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Domain-Name: Default Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Id: 07881abb89354c5baaebad17128c46dd Apr 18 20:25:28 user devstack@n-api.service[61420]: X-User-Name: tempest-VolumesNegativeTest-1359849480-project-member Apr 18 20:25:28 user devstack@n-api.service[61420]: method: Apr 18 20:25:28 user devstack@n-api.service[61420]: exception: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61420]: action_args: {'id': '5de97177-311a-4916-a5ec-31baa1a754b4'} Apr 18 20:25:28 user devstack@n-api.service[61420]: {{(pid=61420) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. (HTTP 404) (Request-ID: req-bfca8f56-178e-40bf-9620-4f0982f87213) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. Apr 18 20:25:28 user devstack@n-api.service[61420]: ERROR nova.api.openstack.wsgi Apr 18 20:25:28 user devstack@n-api.service[61420]: DEBUG nova.api.openstack.wsgi [None req-fdd17cba-93fa-4294-8143-d65738ea827f tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] Returning 404 to user: Volume 5de97177-311a-4916-a5ec-31baa1a754b4 could not be found. {{(pid=61420) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:25:28 user devstack@n-api.service[61420]: INFO nova.api.openstack.requestlog [None req-fdd17cba-93fa-4294-8143-d65738ea827f tempest-VolumesNegativeTest-1359849480 tempest-VolumesNegativeTest-1359849480-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5de97177-311a-4916-a5ec-31baa1a754b4" status: 404 len: 109 microversion: 2.1 time: 0.092146 Apr 18 20:25:28 user devstack@n-api.service[61420]: [pid: 61420|app: 0|req: 157/456] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:25:28 2023] GET /compute/v2.1/os-volumes/5de97177-311a-4916-a5ec-31baa1a754b4 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)