Apr 20 05:22:05 user devstack@n-api.service[72595]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 05:22:05 user devstack@n-api.service[72595]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 05:22:05 2023] *** Apr 20 05:22:05 user devstack@n-api.service[72595]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 05:22:05 user devstack@n-api.service[72595]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 05:22:05 user devstack@n-api.service[72595]: nodename: user Apr 20 05:22:05 user devstack@n-api.service[72595]: machine: x86_64 Apr 20 05:22:05 user devstack@n-api.service[72595]: clock source: unix Apr 20 05:22:05 user devstack@n-api.service[72595]: pcre jit disabled Apr 20 05:22:05 user devstack@n-api.service[72595]: detected number of CPU cores: 12 Apr 20 05:22:05 user devstack@n-api.service[72595]: current working directory: / Apr 20 05:22:05 user devstack@n-api.service[72595]: detected binary path: /usr/bin/uwsgi-core Apr 20 05:22:05 user devstack@n-api.service[72595]: your processes number limit is 63638 Apr 20 05:22:05 user devstack@n-api.service[72595]: your memory page size is 4096 bytes Apr 20 05:22:05 user devstack@n-api.service[72595]: detected max file descriptor number: 2048 Apr 20 05:22:05 user devstack@n-api.service[72595]: lock engine: pthread robust mutexes Apr 20 05:22:05 user devstack@n-api.service[72595]: thunder lock: enabled Apr 20 05:22:05 user devstack@n-api.service[72595]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 05:22:05 user devstack@n-api.service[72595]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 05:22:05 user devstack@n-api.service[72595]: Python main interpreter initialized at 0x5649a263d990 Apr 20 05:22:05 user devstack@n-api.service[72595]: python threads support enabled Apr 20 05:22:05 user devstack@n-api.service[72595]: your server socket listen backlog is limited to 100 connections Apr 20 05:22:05 user devstack@n-api.service[72595]: your mercy for graceful operations on workers is 90 seconds Apr 20 05:22:05 user devstack@n-api.service[72595]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 05:22:05 user devstack@n-api.service[72595]: *** Operational MODE: preforking *** Apr 20 05:22:05 user devstack@n-api.service[72595]: *** uWSGI is running in multiple interpreter mode *** Apr 20 05:22:05 user devstack@n-api.service[72595]: spawned uWSGI master process (pid: 72595) Apr 20 05:22:05 user devstack@n-api.service[72595]: spawned uWSGI worker 1 (pid: 72596, cores: 1) Apr 20 05:22:05 user devstack@n-api.service[72595]: spawned uWSGI worker 2 (pid: 72597, cores: 1) Apr 20 05:22:05 user devstack@n-api.service[72595]: spawned uWSGI worker 3 (pid: 72598, cores: 1) Apr 20 05:22:05 user devstack@n-api.service[72595]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 05:22:05 user devstack@n-api.service[72597]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 05:22:05 user devstack@n-api.service[72596]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 05:22:05 user devstack@n-api.service[72598]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 05:22:09 user devstack@n-api.service[72597]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 05:22:09 user devstack@n-api.service[72597]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 05:22:09 user devstack@n-api.service[72597]: and ``live_migration_inbound_addr`` respectively. Apr 20 05:22:09 user devstack@n-api.service[72597]: ). Its value may be silently ignored in the future. Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 05:22:09 user devstack@n-api.service[72596]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 05:22:09 user devstack@n-api.service[72596]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 05:22:09 user devstack@n-api.service[72596]: and ``live_migration_inbound_addr`` respectively. Apr 20 05:22:09 user devstack@n-api.service[72596]: ). Its value may be silently ignored in the future. Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 05:22:09 user devstack@n-api.service[72598]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 05:22:09 user devstack@n-api.service[72598]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 05:22:09 user devstack@n-api.service[72598]: and ``live_migration_inbound_addr`` respectively. Apr 20 05:22:09 user devstack@n-api.service[72598]: ). Its value may be silently ignored in the future. Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=72598) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 05:22:09 user devstack@n-api.service[72597]: INFO dbcounter [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Registered counter for database nova_api Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writer thread running {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72596]: INFO dbcounter [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Registered counter for database nova_api Apr 20 05:22:09 user devstack@n-api.service[72598]: INFO dbcounter [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Registered counter for database nova_api Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_db.sqlalchemy.engines [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_db.sqlalchemy.engines [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72598) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG nova.context [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae6ab1ab-1140-4b4c-bf55-c15161615bab(cell1) {{(pid=72597) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writer thread running {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writer thread running {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:22:09 user devstack@n-api.service[72597]: INFO dbcounter [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Registered counter for database nova_cell0 Apr 20 05:22:09 user devstack@n-api.service[72597]: INFO dbcounter [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Registered counter for database nova_cell1 Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writer thread running {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writer thread running {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG nova.context [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae6ab1ab-1140-4b4c-bf55-c15161615bab(cell1) {{(pid=72598) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG nova.context [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ae6ab1ab-1140-4b4c-bf55-c15161615bab(cell1) {{(pid=72596) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:22:09 user devstack@n-api.service[72598]: INFO dbcounter [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Registered counter for database nova_cell0 Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:22:09 user devstack@n-api.service[72598]: INFO dbcounter [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Registered counter for database nova_cell1 Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:22:09 user devstack@n-api.service[72596]: INFO dbcounter [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Registered counter for database nova_cell0 Apr 20 05:22:09 user devstack@n-api.service[72596]: INFO dbcounter [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Registered counter for database nova_cell1 Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_db.sqlalchemy.engines [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72598) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writer thread running {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_db.sqlalchemy.engines [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72598) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_db.sqlalchemy.engines [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writer thread running {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_db.sqlalchemy.engines [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72597]: INFO dbcounter [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Registered counter for database nova_cell0 Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG oslo_db.sqlalchemy.engines [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writer thread running {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writer thread running {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72598]: INFO dbcounter [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Registered counter for database nova_cell0 Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG oslo_db.sqlalchemy.engines [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72598) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writer thread running {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writer thread running {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72596]: INFO dbcounter [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Registered counter for database nova_cell0 Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG oslo_db.sqlalchemy.engines [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 05:22:09 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writer thread running {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 05:22:09 user devstack@n-api.service[72597]: WARNING keystonemiddleware.auth_token [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 05:22:09 user devstack@n-api.service[72597]: WARNING keystonemiddleware.auth_token [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 05:22:09 user devstack@n-api.service[72598]: WARNING keystonemiddleware.auth_token [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 05:22:09 user devstack@n-api.service[72598]: WARNING keystonemiddleware.auth_token [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 05:22:10 user devstack@n-api.service[72597]: WARNING keystonemiddleware.auth_token [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 05:22:10 user devstack@n-api.service[72597]: WARNING keystonemiddleware.auth_token [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 05:22:10 user devstack@n-api.service[72597]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649a263d990 pid: 72597 (default app) Apr 20 05:22:10 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:22:10 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001502 Apr 20 05:22:10 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 05:22:10 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:22:10 user devstack@n-api.service[72596]: WARNING keystonemiddleware.auth_token [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 05:22:10 user devstack@n-api.service[72596]: WARNING keystonemiddleware.auth_token [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 05:22:10 user devstack@n-api.service[72598]: WARNING keystonemiddleware.auth_token [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 05:22:10 user devstack@n-api.service[72598]: WARNING keystonemiddleware.auth_token [None req-3aa9248b-187c-410b-877a-ea719fd00d0c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 05:22:10 user devstack@n-api.service[72598]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649a263d990 pid: 72598 (default app) Apr 20 05:22:10 user devstack@n-api.service[72596]: WARNING keystonemiddleware.auth_token [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 05:22:10 user devstack@n-api.service[72596]: WARNING keystonemiddleware.auth_token [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 05:22:10 user devstack@n-api.service[72596]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649a263d990 pid: 72596 (default app) Apr 20 05:24:17 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-d4951bd6-0687-4b7d-a468-f2f0a6c6ef4c None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001403 Apr 20 05:24:17 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:17 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:17 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=3 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:17 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=3 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:17 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=3 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:17 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=3 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:17 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-8182a259-7398-4c84-b1e4-05296dc3c2ee admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:17 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-8182a259-7398-4c84-b1e4-05296dc3c2ee admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.414448 Apr 20 05:24:17 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 05:24:17 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:19 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001995 Apr 20 05:24:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:19 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=3 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:19 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=3 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:19 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=3 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:19 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-ca1451e1-e4d5-42d6-b673-cac59f23188d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-ca1451e1-e4d5-42d6-b673-cac59f23188d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.311705 Apr 20 05:24:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:19 2023] POST /compute/v2.1/flavors => generated 405 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:19 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-a3dcbfed-32a9-4988-b93b-d9849a06f406 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-a3dcbfed-32a9-4988-b93b-d9849a06f406 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045678 Apr 20 05:24:19 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 05:24:19 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:21 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001323 Apr 20 05:24:21 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:21 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:21 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-2708ee36-3214-48d6-9f02-2269cf23f73c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "swap": 0, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:21 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-2708ee36-3214-48d6-9f02-2269cf23f73c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064514 Apr 20 05:24:21 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:21 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:21 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-f0c007b7-95d3-41c6-ba3f-6df72ffeda51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:21 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-f0c007b7-95d3-41c6-ba3f-6df72ffeda51 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026515 Apr 20 05:24:21 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 05:24:21 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:23 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:23 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001306 Apr 20 05:24:23 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:23 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:23 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a939477b-824e-411a-9b18-9c0197f05880 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a939477b-824e-411a-9b18-9c0197f05880 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058579 Apr 20 05:24:23 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:23 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:23 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-eb487809-34e4-4d93-9728-ecad411e3fa9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:23 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-eb487809-34e4-4d93-9728-ecad411e3fa9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025118 Apr 20 05:24:23 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 05:24:23 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:25 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:25 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001532 Apr 20 05:24:25 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:25 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-2cb0696e-8283-4aee-a5bd-4ef005749b30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 10, "id": "d3", "vcpus": 2, "name": "ds2G"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:25 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-2cb0696e-8283-4aee-a5bd-4ef005749b30 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.060077 Apr 20 05:24:25 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:25 2023] POST /compute/v2.1/flavors => generated 402 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:25 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-43305162-b9d1-4d87-be21-7cdcdd83b198 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:25 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-43305162-b9d1-4d87-be21-7cdcdd83b198 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026594 Apr 20 05:24:25 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 05:24:25 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:27 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:27 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001374 Apr 20 05:24:27 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:27 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:27 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a5251bd7-5bf3-4824-93f4-66631ee4bd4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:27 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a5251bd7-5bf3-4824-93f4-66631ee4bd4d admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.064973 Apr 20 05:24:27 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:27 2023] POST /compute/v2.1/flavors => generated 402 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:27 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023910 Apr 20 05:24:27 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 05:24:27 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:29 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:29 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fae1d900-8fa3-4d78-b7f3-b6a501ddd2a6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001317 Apr 20 05:24:29 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:29 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-4ccaee63-bafc-4de2-b9d8-3d796a5eb438 admin admin] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:29 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-4ccaee63-bafc-4de2-b9d8-3d796a5eb438 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.071482 Apr 20 05:24:29 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 05:24:29 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:24:31 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:31 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001499 Apr 20 05:24:31 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:31 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:31 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:31 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:31 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:24:31 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b898fc44-8d17-4d3a-93cc-149cd0578f2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "id": "1"}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:31 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b898fc44-8d17-4d3a-93cc-149cd0578f2c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.311930 Apr 20 05:24:31 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:31 2023] POST /compute/v2.1/flavors => generated 400 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:31 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-fcd2ffe3-561b-4b13-9d76-d21928b2e4c6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:31 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-fcd2ffe3-561b-4b13-9d76-d21928b2e4c6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040019 Apr 20 05:24:31 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 05:24:31 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 05:24:33 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:33 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001348 Apr 20 05:24:33 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:33 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-853afe49-d0b3-4835-9f1b-c85d0a67ea74 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 20, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:33 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-853afe49-d0b3-4835-9f1b-c85d0a67ea74 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059822 Apr 20 05:24:33 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:33 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:33 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-99f7f594-61b1-4781-8da0-4c0d85169ebf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:33 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-99f7f594-61b1-4781-8da0-4c0d85169ebf admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027828 Apr 20 05:24:33 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 05:24:33 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:35 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:35 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001344 Apr 20 05:24:35 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:35 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:35 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b6d15276-d816-4bc9-8620-21531e4efe5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:35 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b6d15276-d816-4bc9-8620-21531e4efe5e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076973 Apr 20 05:24:35 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:35 2023] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:35 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-f31d270f-de3e-4782-accc-6474263fc416 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:35 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-f31d270f-de3e-4782-accc-6474263fc416 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028113 Apr 20 05:24:35 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 05:24:35 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:37 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:37 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001350 Apr 20 05:24:37 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:37 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:37 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-cbd2ba4f-bf7f-4af0-9749-ba4b756a6fc5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "os-flavor-access:is_public": true, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:37 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-cbd2ba4f-bf7f-4af0-9749-ba4b756a6fc5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.065096 Apr 20 05:24:37 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:37 2023] POST /compute/v2.1/flavors => generated 403 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:37 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-cffb72df-71b1-4e6c-a781-2a1b72bdb963 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:37 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-cffb72df-71b1-4e6c-a781-2a1b72bdb963 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046693 Apr 20 05:24:37 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 05:24:37 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:24:39 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:24:39 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001394 Apr 20 05:24:39 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 05:24:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:24:39 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-71efbd69-2ada-435c-a508-67be45da1ed9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "disk": 160}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:39 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-71efbd69-2ada-435c-a508-67be45da1ed9 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.057497 Apr 20 05:24:39 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 05:24:39 2023] POST /compute/v2.1/flavors => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:24:39 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-28cbf5cc-f94a-47b1-a28b-9bdcc6b776af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:24:39 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-28cbf5cc-f94a-47b1-a28b-9bdcc6b776af admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027091 Apr 20 05:24:39 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 05:24:39 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:25:10 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:25:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0fff6e61-5d14-49f3-ac59-9dcb01c8ff12 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001425 Apr 20 05:25:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 05:25:10 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:25:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:25:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.095832 Apr 20 05:25:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 05:25:10 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:25:42 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-28cbf5cc-f94a-47b1-a28b-9bdcc6b776af admin admin] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:25:42 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-28cbf5cc-f94a-47b1-a28b-9bdcc6b776af admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001675 Apr 20 05:25:42 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 05:25:42 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:25:42 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:25:42 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-011e60bb-cac8-41ca-bd64-402680db8ef6 admin admin] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:25:42 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-011e60bb-cac8-41ca-bd64-402680db8ef6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.067627 Apr 20 05:25:42 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 05:25:42 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:25:46 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:25:46 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001679 Apr 20 05:25:46 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 05:25:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:25:46 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:25:46 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-921c021a-54a9-4680-8bf7-323c381944b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "42", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 128, "name": "m1.nano", "disk": 1, "swap": 0}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:25:46 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-921c021a-54a9-4680-8bf7-323c381944b6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067674 Apr 20 05:25:46 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 05:25:46 2023] POST /compute/v2.1/flavors => generated 403 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:25:46 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d1952cc9-9c92-4ae2-9272-e684044b1321 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:25:46 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d1952cc9-9c92-4ae2-9272-e684044b1321 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025037 Apr 20 05:25:46 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 05:25:46 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:25:50 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:25:50 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-98cd745f-d450-4bfe-bbfe-77b9c125398b admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001977 Apr 20 05:25:50 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 05:25:50 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:25:50 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7eb16fa7-3630-4058-8fcf-10dfdf12d164 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "84", "os-flavor-access:is_public": true, "ram": 192, "name": "m1.micro"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:25:50 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7eb16fa7-3630-4058-8fcf-10dfdf12d164 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.064082 Apr 20 05:25:50 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 05:25:50 2023] POST /compute/v2.1/flavors => generated 404 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:25:50 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-63703aea-4d25-4456-b9ad-9a737ad5d781 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:25:50 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-63703aea-4d25-4456-b9ad-9a737ad5d781 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025037 Apr 20 05:25:50 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 05:25:50 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:28:16 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:16 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:16 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:16 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-40077a3e-25e6-4157-ac02-b6ae050e1ce1 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Action: 'create', calling method: .version_select at 0x7ff3036a30a0>, body: {"keypair": {"name": "tempest-keypair-840035893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKikIQWd05Ta1fcpuOoQan5PkLdCv2osqZRgqxrG1JcEHUrMFjNpTU1vIvkhtlh4foHkH2e70yzihn3H7OqCOrwZg/ic8lo/IjVwXdsJOZKFkUUCuixiR6575DWyDj8A6A=="}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:17 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-40077a3e-25e6-4157-ac02-b6ae050e1ce1 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Getting quotas for project 83045a7a115e4207b19dab56c08be584. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:17 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-40077a3e-25e6-4157-ac02-b6ae050e1ce1 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Getting quotas for user 6beb804304e94477ba224d9066ede268 and project 83045a7a115e4207b19dab56c08be584. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:17 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-40077a3e-25e6-4157-ac02-b6ae050e1ce1 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253282 Apr 20 05:28:17 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:28:16 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:19 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5d76e918-8ab9-4856-9bae-642d4874b822 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Action: 'create', calling method: .version_select at 0x7ff3036a2290>, body: {"keypair": {"name": "tempest-keypair-296371510", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLiqJm2QUND09tMh9nU7CWIfhGDNIunqx7uYtl5vZrkZUlZcmvgfCMBSz8QftxRnnfALup2x9fA/sjbxAXqqoz7SezGn86gP9z5VAeNb9hH4SbhGBdHZcF9+mupG1DtCRQ=="}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:19 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-5d76e918-8ab9-4856-9bae-642d4874b822 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for project c1069c90da8244529aca2b5907e46691. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:19 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-5d76e918-8ab9-4856-9bae-642d4874b822 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for user 1558ef8ec15f4bcaa4d8a73bf3b457bc and project c1069c90da8244529aca2b5907e46691. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5d76e918-8ab9-4856-9bae-642d4874b822 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.251239 Apr 20 05:28:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 17/47] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:28:19 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:20 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:20 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-3326d4a1-a235-4827-b490-dc281b057c2c tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Action: 'create', calling method: .version_select at 0x7ff3038c7e20>, body: {"keypair": {"name": "tempest-keypair-532733036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLFHRRPrsCaIrE61Tz1aL3WWlLinJO2s1Iihp7MyDgYLLQFD3lRCVetkPwhOXoj7VnZgjVaX6pLu3P2T4HuMPV+Dbl0IkyVA3tvglsr/FlCEdJllNvzScMweffHYir2FqA=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:20 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-3326d4a1-a235-4827-b490-dc281b057c2c tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:20 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-3326d4a1-a235-4827-b490-dc281b057c2c tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for user 1071a61ffe56426997058ad6c6a2c486 and project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:20 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-3326d4a1-a235-4827-b490-dc281b057c2c tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.217515 Apr 20 05:28:20 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:28:20 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:23 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1733441759", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "3d4e6b0c-cdb1-463c-bbb2-ac602f68db1a"}], "security_groups": [{"name": "tempest-securitygroup--128928648"}], "key_name": "tempest-keypair-840035893", "user_data": "}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:24 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] validate_networks() for [('3d4e6b0c-cdb1-463c-bbb2-ac602f68db1a', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:25 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1850556475", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "f0cb9047-57a2-4e4a-aaa8-36ed35617e4d"}]}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:25 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] validate_networks() for [('f0cb9047-57a2-4e4a-aaa8-36ed35617e4d', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:25 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-309695821", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "8922cf58-d9e1-424f-8aba-133b11372bf4"}]}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:26 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] validate_networks() for [('8922cf58-d9e1-424f-8aba-133b11372bf4', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Getting quotas for project 83045a7a115e4207b19dab56c08be584. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Getting quotas for user 6beb804304e94477ba224d9066ede268 and project 83045a7a115e4207b19dab56c08be584. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-cf60f8e5-8cc1-4b42-8172-db1e17efb927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.564745 Apr 20 05:28:26 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 16/49] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:28:23 2023] POST /compute/v2.1/servers => generated 406 bytes in 2567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-89cefbc9-4999-4c40-8bd7-78eeeaecce92 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-89cefbc9-4999-4c40-8bd7-78eeeaecce92 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-89cefbc9-4999-4c40-8bd7-78eeeaecce92 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-89cefbc9-4999-4c40-8bd7-78eeeaecce92 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1232 microversion: 2.1 time: 0.139055 Apr 20 05:28:26 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 17/50] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:28:26 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1232 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:28:26 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-596543705", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "e0617596-5631-4c4b-8dd3-14d66bf18124"}]}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:27 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] validate_networks() for [('e0617596-5631-4c4b-8dd3-14d66bf18124', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Getting quotas for project 4e0e7a7d59fd49c3aaaedbf085980c96. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Getting quotas for user 198edaee95b0445b8cb018046d790576 and project 4e0e7a7d59fd49c3aaaedbf085980c96. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-7b66a3cd-90f5-4a28-adcc-44a827030a23 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.086950 Apr 20 05:28:27 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:28:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:28:27 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1919304645", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "095a8a82-6992-4f8a-b50b-f67a659d9247"}], "security_groups": [{"name": "tempest-securitygroup--1600494429"}], "key_name": "tempest-keypair-296371510", "user_data": "}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Getting quotas for project 4ca4a6041fb3472ebfa953dff7ce031c. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Getting quotas for user 636e86cdf83e480595e4f0dba3bf8c18 and project 4ca4a6041fb3472ebfa953dff7ce031c. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:28 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] validate_networks() for [('095a8a82-6992-4f8a-b50b-f67a659d9247', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:28 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-b30ab560-20ba-4a72-8120-441d1f124a63 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 3.215181 Apr 20 05:28:28 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 18/52] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:28:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 3217 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-51a6d705-196e-47df-83f9-05ecf55c4ba4 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-51a6d705-196e-47df-83f9-05ecf55c4ba4 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-51a6d705-196e-47df-83f9-05ecf55c4ba4 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:28 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-51a6d705-196e-47df-83f9-05ecf55c4ba4 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1210 microversion: 2.1 time: 0.170249 Apr 20 05:28:28 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:28:28 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1210 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-23cd8761-f9e8-4b11-8864-ab05c5546145 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-23cd8761-f9e8-4b11-8864-ab05c5546145 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for user 82ae116ab3d844afa141c1186f2f63d9 and project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-23cd8761-f9e8-4b11-8864-ab05c5546145 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636e86cdf83e480595e4f0dba3bf8c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca4a6041fb3472ebfa953dff7ce031c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:28 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-23cd8761-f9e8-4b11-8864-ab05c5546145 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899" status: 200 len: 1209 microversion: 2.1 time: 0.130288 Apr 20 05:28:28 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 20/54] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:28:28 2023] GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899 => generated 1209 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:28:28 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-e7eca3ca-7e50-4758-b6f4-3232d926a438 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.757220 Apr 20 05:28:28 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 18/55] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 05:28:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-511110022", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "37fb57c1-9e9d-4bc4-8dfb-6377c6d9ff4a"}], "security_groups": [{"name": "tempest-securitygroup--1748238773"}], "key_name": "tempest-keypair-532733036", "user_data": "}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-197dd3eb-a2be-465d-bc2d-09a3b5449d5b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-197dd3eb-a2be-465d-bc2d-09a3b5449d5b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-197dd3eb-a2be-465d-bc2d-09a3b5449d5b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-197dd3eb-a2be-465d-bc2d-09a3b5449d5b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:28 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-197dd3eb-a2be-465d-bc2d-09a3b5449d5b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:28 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-197dd3eb-a2be-465d-bc2d-09a3b5449d5b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41" status: 200 len: 1394 microversion: 2.87 time: 0.134418 Apr 20 05:28:28 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:28:28 2023] GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 => generated 1394 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:28:28 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] validate_networks() for [('37fb57c1-9e9d-4bc4-8dfb-6377c6d9ff4a', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for project c1069c90da8244529aca2b5907e46691. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for user 1558ef8ec15f4bcaa4d8a73bf3b457bc and project c1069c90da8244529aca2b5907e46691. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:29 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:29 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-039de1b3-fc31-4fa0-ac27-aa2ca967a2d0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.717443 Apr 20 05:28:29 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 18/57] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:28:27 2023] POST /compute/v2.1/servers => generated 400 bytes in 1719 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:28:29 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-3bdcc99d-2ba0-423d-9357-b29432b5e7c0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:29 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-3bdcc99d-2ba0-423d-9357-b29432b5e7c0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:29 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-3bdcc99d-2ba0-423d-9357-b29432b5e7c0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:29 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-3bdcc99d-2ba0-423d-9357-b29432b5e7c0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 200 len: 1235 microversion: 2.1 time: 0.243672 Apr 20 05:28:29 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 20/58] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:28:29 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 1235 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for user 1071a61ffe56426997058ad6c6a2c486 and project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:30 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:30 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-f01a6d65-9f33-404d-be93-2f6cc1e9e2e7 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.987522 Apr 20 05:28:30 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 21/59] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:28:28 2023] POST /compute/v2.1/servers => generated 400 bytes in 1993 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:28:30 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d33549e7-f4ad-48e6-8460-54d16fb41df9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:30 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-d33549e7-f4ad-48e6-8460-54d16fb41df9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:30 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-d33549e7-f4ad-48e6-8460-54d16fb41df9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1071a61ffe56426997058ad6c6a2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6404b98cd405456f8d4c275b72ef3d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:30 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d33549e7-f4ad-48e6-8460-54d16fb41df9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 200 len: 1230 microversion: 2.1 time: 0.174809 Apr 20 05:28:30 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 19/60] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:28:30 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 1230 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:34 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Creating event network-changed:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72596) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2621d6ea-a433-45ff-a117-a41320b0a6d6 req-df4d6da1-e9f1-4b4f-8e79-edb14c926f1c service nova] Acquired lock "compute-rpcapi-router" {{(pid=72596) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:34 user devstack@n-api.service[72596]: INFO nova.compute.rpcapi [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 05:28:34 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] Releasing lock "compute-rpcapi-router" {{(pid=72596) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 05:28:34 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-7f6865a5-c5e8-44b2-96b2-731bd3a31f34 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146713 Apr 20 05:28:34 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 21/61] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06aa1ee3-10da-4e16-a5a9-75b2f6089899", "tag": "ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5"}, {"name": "network-changed", "server_uuid": "d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41", "tag": "38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "tag": "b831830b-a235-411f-857f-00c256b1be91"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:36 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Creating event network-changed:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72597) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-86d8c9a6-81a4-450e-abd3-5f5c47a8040e req-9aa583ec-e25e-41f4-9109-df52d0eaf2ae service nova] Acquired lock "compute-rpcapi-router" {{(pid=72597) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:36 user devstack@n-api.service[72597]: INFO nova.compute.rpcapi [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 05:28:36 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] Releasing lock "compute-rpcapi-router" {{(pid=72597) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 05:28:36 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-b4e3b12d-a13e-41fb-928d-a757df4506cf None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217083 Apr 20 05:28:36 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 22/62] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:36 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Creating event network-changed:ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5 for instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 on user Apr 20 05:28:36 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Creating event network-changed:38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2 for instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 on user Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=72598) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-36494478-1de8-4c47-b4ab-285535f0c4b4 req-c5e24951-e9ec-456b-8e12-b6bc18a2d798 service nova] Acquired lock "compute-rpcapi-router" {{(pid=72598) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:36 user devstack@n-api.service[72598]: INFO nova.compute.rpcapi [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 05:28:36 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] Releasing lock "compute-rpcapi-router" {{(pid=72598) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 05:28:36 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-47b72e66-1ce3-444a-8091-e19bf1c44400 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.162904 Apr 20 05:28:36 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 20/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:36 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:37 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-d9c924c1-b062-4657-b14d-fc782b71b9d1 req-e48672a3-e32d-483b-9999-5d65d75414da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75ddf1a2-942d-4240-afbe-20194c1845ca", "tag": "00934807-0f00-4feb-872a-b5e8c89789f3"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:37 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d9c924c1-b062-4657-b14d-fc782b71b9d1 req-e48672a3-e32d-483b-9999-5d65d75414da service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:37 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d9c924c1-b062-4657-b14d-fc782b71b9d1 req-e48672a3-e32d-483b-9999-5d65d75414da service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:37 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d9c924c1-b062-4657-b14d-fc782b71b9d1 req-e48672a3-e32d-483b-9999-5d65d75414da service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:37 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-d9c924c1-b062-4657-b14d-fc782b71b9d1 req-e48672a3-e32d-483b-9999-5d65d75414da service nova] Creating event network-changed:00934807-0f00-4feb-872a-b5e8c89789f3 for instance 75ddf1a2-942d-4240-afbe-20194c1845ca on user Apr 20 05:28:37 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-d9c924c1-b062-4657-b14d-fc782b71b9d1 req-e48672a3-e32d-483b-9999-5d65d75414da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137405 Apr 20 05:28:37 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:39 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-f501c639-db4d-41cc-914a-9fe846056554 req-2e54625b-8385-4b14-ac8c-b2a3179f34db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:39 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-f501c639-db4d-41cc-914a-9fe846056554 req-2e54625b-8385-4b14-ac8c-b2a3179f34db service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:39 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-f501c639-db4d-41cc-914a-9fe846056554 req-2e54625b-8385-4b14-ac8c-b2a3179f34db service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:39 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-f501c639-db4d-41cc-914a-9fe846056554 req-2e54625b-8385-4b14-ac8c-b2a3179f34db service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:39 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-f501c639-db4d-41cc-914a-9fe846056554 req-2e54625b-8385-4b14-ac8c-b2a3179f34db service nova] Creating event network-changed:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:28:39 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-f501c639-db4d-41cc-914a-9fe846056554 req-2e54625b-8385-4b14-ac8c-b2a3179f34db service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040449 Apr 20 05:28:39 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 23/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:43 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=18 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:43 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-c5ce3706-ef36-47d0-862b-51fe9e266f9e req-64559fa5-9f72-44b9-945a-0cf5e074cb89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "name": "network-vif-plugged", "status": "completed", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:43 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c5ce3706-ef36-47d0-862b-51fe9e266f9e req-64559fa5-9f72-44b9-945a-0cf5e074cb89 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:43 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c5ce3706-ef36-47d0-862b-51fe9e266f9e req-64559fa5-9f72-44b9-945a-0cf5e074cb89 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:43 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c5ce3706-ef36-47d0-862b-51fe9e266f9e req-64559fa5-9f72-44b9-945a-0cf5e074cb89 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:43 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-c5ce3706-ef36-47d0-862b-51fe9e266f9e req-64559fa5-9f72-44b9-945a-0cf5e074cb89 service nova] Creating event network-vif-plugged:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:28:43 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-c5ce3706-ef36-47d0-862b-51fe9e266f9e req-64559fa5-9f72-44b9-945a-0cf5e074cb89 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052109 Apr 20 05:28:43 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 21/66] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:43 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=22 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:43 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-7481769f-947a-46c9-9288-90dc517b7b12 req-093d0aac-1ca0-407f-91a2-a5ceb21fd5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ddf1a2-942d-4240-afbe-20194c1845ca", "name": "network-vif-plugged", "status": "completed", "tag": "00934807-0f00-4feb-872a-b5e8c89789f3"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-7481769f-947a-46c9-9288-90dc517b7b12 req-093d0aac-1ca0-407f-91a2-a5ceb21fd5e0 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-7481769f-947a-46c9-9288-90dc517b7b12 req-093d0aac-1ca0-407f-91a2-a5ceb21fd5e0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-7481769f-947a-46c9-9288-90dc517b7b12 req-093d0aac-1ca0-407f-91a2-a5ceb21fd5e0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:43 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-7481769f-947a-46c9-9288-90dc517b7b12 req-093d0aac-1ca0-407f-91a2-a5ceb21fd5e0 service nova] Creating event network-vif-plugged:00934807-0f00-4feb-872a-b5e8c89789f3 for instance 75ddf1a2-942d-4240-afbe-20194c1845ca on user Apr 20 05:28:43 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-7481769f-947a-46c9-9288-90dc517b7b12 req-093d0aac-1ca0-407f-91a2-a5ceb21fd5e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047304 Apr 20 05:28:43 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 23/67] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:44 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=20 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:44 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-b8030060-550e-4f83-adf3-64a7703cf8be req-02c22993-362d-44cb-a423-58f94799aec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "name": "network-vif-plugged", "status": "completed", "tag": "b831830b-a235-411f-857f-00c256b1be91"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b8030060-550e-4f83-adf3-64a7703cf8be req-02c22993-362d-44cb-a423-58f94799aec9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b8030060-550e-4f83-adf3-64a7703cf8be req-02c22993-362d-44cb-a423-58f94799aec9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b8030060-550e-4f83-adf3-64a7703cf8be req-02c22993-362d-44cb-a423-58f94799aec9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:44 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-b8030060-550e-4f83-adf3-64a7703cf8be req-02c22993-362d-44cb-a423-58f94799aec9 service nova] Creating event network-vif-plugged:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:28:44 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-b8030060-550e-4f83-adf3-64a7703cf8be req-02c22993-362d-44cb-a423-58f94799aec9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038471 Apr 20 05:28:44 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 24/68] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:45 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "name": "network-vif-plugged", "status": "completed", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}, {"server_uuid": "d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41", "name": "network-vif-plugged", "status": "completed", "tag": "38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2"}, {"server_uuid": "d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41", "name": "network-vif-plugged", "status": "completed", "tag": "38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:45 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:45 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:45 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:45 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Creating event network-vif-plugged:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:28:45 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Creating event network-vif-plugged:38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2 for instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 on user Apr 20 05:28:45 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] Creating event network-vif-plugged:38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2 for instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 on user Apr 20 05:28:45 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-eb1f70c9-8e61-4a2b-8ba5-33d7f1ce6233 req-8918b3c7-7294-42d0-9c50-d48161b36b66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.061646 Apr 20 05:28:45 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 22/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:45 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:45 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ddf1a2-942d-4240-afbe-20194c1845ca", "name": "network-vif-plugged", "status": "completed", "tag": "00934807-0f00-4feb-872a-b5e8c89789f3"}, {"server_uuid": "06aa1ee3-10da-4e16-a5a9-75b2f6089899", "name": "network-vif-plugged", "status": "completed", "tag": "ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5"}, {"server_uuid": "06aa1ee3-10da-4e16-a5a9-75b2f6089899", "name": "network-vif-plugged", "status": "completed", "tag": "ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:45 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Creating event network-vif-plugged:00934807-0f00-4feb-872a-b5e8c89789f3 for instance 75ddf1a2-942d-4240-afbe-20194c1845ca on user Apr 20 05:28:45 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Creating event network-vif-plugged:ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5 for instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 on user Apr 20 05:28:45 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] Creating event network-vif-plugged:ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5 for instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 on user Apr 20 05:28:45 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-a56d8e42-b3e7-46fb-8091-906098230e69 req-83b6bbd5-d38f-40b8-8723-a9e49d7cc0b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037076 Apr 20 05:28:45 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:46 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:46 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-9b6be0fe-e59a-4a79-9201-133db6aa71e5 req-369d8a0f-3c91-429e-8903-60eab148905a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "name": "network-vif-plugged", "status": "completed", "tag": "b831830b-a235-411f-857f-00c256b1be91"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9b6be0fe-e59a-4a79-9201-133db6aa71e5 req-369d8a0f-3c91-429e-8903-60eab148905a service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9b6be0fe-e59a-4a79-9201-133db6aa71e5 req-369d8a0f-3c91-429e-8903-60eab148905a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9b6be0fe-e59a-4a79-9201-133db6aa71e5 req-369d8a0f-3c91-429e-8903-60eab148905a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:47 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-9b6be0fe-e59a-4a79-9201-133db6aa71e5 req-369d8a0f-3c91-429e-8903-60eab148905a service nova] Creating event network-vif-plugged:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:28:47 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-9b6be0fe-e59a-4a79-9201-133db6aa71e5 req-369d8a0f-3c91-429e-8903-60eab148905a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100855 Apr 20 05:28:47 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 25/71] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:49 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-bea34c71-0079-4eea-a06c-7eec51a8e70d req-331e6eb2-273b-4e4c-8ff4-3b61b507fb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "name": "network-vif-plugged", "status": "completed", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bea34c71-0079-4eea-a06c-7eec51a8e70d req-331e6eb2-273b-4e4c-8ff4-3b61b507fb46 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bea34c71-0079-4eea-a06c-7eec51a8e70d req-331e6eb2-273b-4e4c-8ff4-3b61b507fb46 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bea34c71-0079-4eea-a06c-7eec51a8e70d req-331e6eb2-273b-4e4c-8ff4-3b61b507fb46 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:49 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-bea34c71-0079-4eea-a06c-7eec51a8e70d req-331e6eb2-273b-4e4c-8ff4-3b61b507fb46 service nova] Creating event network-vif-plugged:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:28:49 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-bea34c71-0079-4eea-a06c-7eec51a8e70d req-331e6eb2-273b-4e4c-8ff4-3b61b507fb46 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068041 Apr 20 05:28:49 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 23/72] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:51 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-5a30e3e8-48d1-4f86-82c1-8ff5f3c4a8a0 req-03d59b13-0a84-4ec0-bb42-6e4373e9f769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "name": "network-vif-plugged", "status": "completed", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:51 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=7 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:51 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-5a30e3e8-48d1-4f86-82c1-8ff5f3c4a8a0 req-03d59b13-0a84-4ec0-bb42-6e4373e9f769 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:51 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-5a30e3e8-48d1-4f86-82c1-8ff5f3c4a8a0 req-03d59b13-0a84-4ec0-bb42-6e4373e9f769 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:51 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-5a30e3e8-48d1-4f86-82c1-8ff5f3c4a8a0 req-03d59b13-0a84-4ec0-bb42-6e4373e9f769 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:51 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=15 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:51 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-5a30e3e8-48d1-4f86-82c1-8ff5f3c4a8a0 req-03d59b13-0a84-4ec0-bb42-6e4373e9f769 service nova] Creating event network-vif-plugged:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:28:51 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-5a30e3e8-48d1-4f86-82c1-8ff5f3c4a8a0 req-03d59b13-0a84-4ec0-bb42-6e4373e9f769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070342 Apr 20 05:28:51 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 25/73] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:28:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 05:28:53 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-47a5206e-76e4-409f-960e-c02f4bae21df tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Action: 'create', calling method: .version_select at 0x7ff3035ffb50>, body: {"keypair": {"name": "tempest-keypair-1504348446", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqiKS/SHzj2qKbO5Sdo69zyvvtnNND2p1E6Vy8QxQe05n3Zi0yc0FqMzWWoKXlEZ1qT3PFlGr5pBENcde8fePCTDiaREPxhzeiYalS1PQIE2rwZwt6YIxNKARJU6kcgXA=="}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:53 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:53 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-47a5206e-76e4-409f-960e-c02f4bae21df tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Getting quotas for project 3acb217a867f47aab97360ef5dd2e98c. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:53 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-47a5206e-76e4-409f-960e-c02f4bae21df tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Getting quotas for user 8afc1850f3ae430f92db6158f202fd21 and project 3acb217a867f47aab97360ef5dd2e98c. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:53 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-47a5206e-76e4-409f-960e-c02f4bae21df tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.476949 Apr 20 05:28:53 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 26/74] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:28:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:28:57 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-702428099", "imageRef": "64f0ac76-aa76-468a-9730-62179f793d33", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "639bee97-2341-4eec-9836-c8e155853404"}], "security_groups": [{"name": "tempest-securitygroup--1798790406"}], "key_name": "tempest-keypair-1504348446", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:28:57 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:57 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] validate_networks() for [('639bee97-2341-4eec-9836-c8e155853404', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=15 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Getting quotas for project 3acb217a867f47aab97360ef5dd2e98c. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Getting quotas for user 8afc1850f3ae430f92db6158f202fd21 and project 3acb217a867f47aab97360ef5dd2e98c. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:28:58 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='64f0ac76-aa76-468a-9730-62179f793d33',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:28:58 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-30ed119e-7ae0-4faa-8483-4875918f0a89 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.514273 Apr 20 05:28:58 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 24/75] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:28:57 2023] POST /compute/v2.1/servers => generated 404 bytes in 1516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:28:58 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-82074c0f-784d-4b1b-8481-7cde1a7bae25 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:28:58 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-82074c0f-784d-4b1b-8481-7cde1a7bae25 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:28:59 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-82074c0f-784d-4b1b-8481-7cde1a7bae25 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afc1850f3ae430f92db6158f202fd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb217a867f47aab97360ef5dd2e98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:28:59 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-82074c0f-784d-4b1b-8481-7cde1a7bae25 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 200 len: 1239 microversion: 2.1 time: 0.336984 Apr 20 05:28:59 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:28:58 2023] GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 1239 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:02 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=14 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:02 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-02a2f416-1d05-4089-8915-8e49090ea3a0 tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Action: 'create', calling method: .version_select at 0x7ff3035ff490>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-834009242", "metadata": {"Type": "work"}}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:03 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-02a2f416-1d05-4089-8915-8e49090ea3a0 tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.928824 Apr 20 05:29:03 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 27/77] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 05:29:02 2023] POST /compute/v2.1/os-volumes => generated 352 bytes in 931 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 05:29:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-195bba52-b6b3-4bf8-be0e-3f564d585e87 tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Calling method '.version_select at 0x7ff30349dea0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-195bba52-b6b3-4bf8-be0e-3f564d585e87 tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac" status: 200 len: 349 microversion: 2.1 time: 0.127866 Apr 20 05:29:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 25/78] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:29:03 2023] GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac => generated 349 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:04 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:04 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-26ab9fb9-76e0-4776-9464-3b524e2c1fbc tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Calling method '.version_select at 0x7ff302c52200>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:04 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-26ab9fb9-76e0-4776-9464-3b524e2c1fbc tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac" status: 200 len: 349 microversion: 2.1 time: 0.100603 Apr 20 05:29:04 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 27/79] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:29:04 2023] GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac => generated 349 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:04 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=4 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:04 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:04 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-17a06f13-aa4c-4f0c-b184-93f9208174f6 tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Calling method '.version_select at 0x7ff302c98790>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:04 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-17a06f13-aa4c-4f0c-b184-93f9208174f6 tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac" status: 202 len: 0 microversion: 2.1 time: 0.197481 Apr 20 05:29:04 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 28/80] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:29:04 2023] DELETE /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 05:29:04 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-6544abcd-f0c3-4540-93b6-5fb8b51548da tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Calling method '.version_select at 0x7ff302b07370>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:04 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-5d93c908-374a-4692-92e7-cd85499927a0 req-771a86f6-3815-48ca-a7b0-3c09a41cf5ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:04 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-5d93c908-374a-4692-92e7-cd85499927a0 req-771a86f6-3815-48ca-a7b0-3c09a41cf5ae service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:04 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-5d93c908-374a-4692-92e7-cd85499927a0 req-771a86f6-3815-48ca-a7b0-3c09a41cf5ae service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:04 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-5d93c908-374a-4692-92e7-cd85499927a0 req-771a86f6-3815-48ca-a7b0-3c09a41cf5ae service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:04 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-5d93c908-374a-4692-92e7-cd85499927a0 req-771a86f6-3815-48ca-a7b0-3c09a41cf5ae service nova] Creating event network-changed:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:29:04 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-5d93c908-374a-4692-92e7-cd85499927a0 req-771a86f6-3815-48ca-a7b0-3c09a41cf5ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076808 Apr 20 05:29:04 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 28/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:04 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-6544abcd-f0c3-4540-93b6-5fb8b51548da tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] HTTP exception thrown: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. Apr 20 05:29:04 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-6544abcd-f0c3-4540-93b6-5fb8b51548da tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Request method failure captured: Apr 20 05:29:04 user devstack@n-api.service[72598]: request: GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac HTTP/1.1 Apr 20 05:29:04 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:29:04 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:29:04 user devstack@n-api.service[72598]: Connection: close Apr 20 05:29:04 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:29:04 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:29:04 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:29:04 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:29:04 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM2em_rXk5vtM9vpBzpRorAk5reaK1dmRxA6hpLnQt1XgQIn0vjJeAz1nbDsc2D_eWEfGmsi9Twc4gYGx3seJXe_LVyWD1Kh79L01wHPIN9Zj85Uxz4oHLamH7b28fq_ktWHyujMwqHxMslpEFniLkJpdQztlEoqPrIOHDNLIxn3zjg Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Project-Id: 7498cb5797954106bdd1aff4ad4f7a24 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Project-Name: tempest-VolumesGetTestJSON-816967869 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7498cb5797954106bdd1aff4ad4f7a24"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7498cb5797954106bdd1aff4ad4f7a24"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7498cb5797954106bdd1aff4ad4f7a24"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Tenant: tempest-VolumesGetTestJSON-816967869 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Tenant-Id: 7498cb5797954106bdd1aff4ad4f7a24 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-VolumesGetTestJSON-816967869 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-User: tempest-VolumesGetTestJSON-816967869-project-member Apr 20 05:29:04 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:29:04 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:29:04 user devstack@n-api.service[72598]: X-User-Id: 4de8ca6d3f5041d5a98e88d996ab7f31 Apr 20 05:29:04 user devstack@n-api.service[72598]: X-User-Name: tempest-VolumesGetTestJSON-816967869-project-member Apr 20 05:29:04 user devstack@n-api.service[72598]: method: Apr 20 05:29:04 user devstack@n-api.service[72598]: exception: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. Apr 20 05:29:04 user devstack@n-api.service[72598]: action_args: {'id': 'ff2dc242-0aae-4a43-934c-29d2c22f67ac'} Apr 20 05:29:04 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. (HTTP 404) (Request-ID: req-6ba1e1a1-af97-4c42-8fe0-b1772abc5cae) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. Apr 20 05:29:04 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:29:04 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-6544abcd-f0c3-4540-93b6-5fb8b51548da tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] Returning 404 to user: Volume ff2dc242-0aae-4a43-934c-29d2c22f67ac could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:29:04 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-6544abcd-f0c3-4540-93b6-5fb8b51548da tempest-VolumesGetTestJSON-816967869 tempest-VolumesGetTestJSON-816967869-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac" status: 404 len: 109 microversion: 2.1 time: 0.130549 Apr 20 05:29:04 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 26/82] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:29:04 2023] GET /compute/v2.1/os-volumes/ff2dc242-0aae-4a43-934c-29d2c22f67ac => generated 109 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:29:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-782850bf-8b12-44c7-a837-870f0feafe58 req-1894c7c9-a939-4b05-a3f1-aa43cefd1b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "name": "network-vif-plugged", "status": "completed", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-782850bf-8b12-44c7-a837-870f0feafe58 req-1894c7c9-a939-4b05-a3f1-aa43cefd1b29 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-782850bf-8b12-44c7-a837-870f0feafe58 req-1894c7c9-a939-4b05-a3f1-aa43cefd1b29 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-782850bf-8b12-44c7-a837-870f0feafe58 req-1894c7c9-a939-4b05-a3f1-aa43cefd1b29 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:08 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-782850bf-8b12-44c7-a837-870f0feafe58 req-1894c7c9-a939-4b05-a3f1-aa43cefd1b29 service nova] Creating event network-vif-plugged:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:29:08 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-782850bf-8b12-44c7-a837-870f0feafe58 req-1894c7c9-a939-4b05-a3f1-aa43cefd1b29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044888 Apr 20 05:29:08 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:10 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-f6610662-cc95-4022-9336-3f269517077c req-85dea8df-d8b0-406e-95f0-235982559053 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "name": "network-vif-plugged", "status": "completed", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-f6610662-cc95-4022-9336-3f269517077c req-85dea8df-d8b0-406e-95f0-235982559053 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-f6610662-cc95-4022-9336-3f269517077c req-85dea8df-d8b0-406e-95f0-235982559053 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-f6610662-cc95-4022-9336-3f269517077c req-85dea8df-d8b0-406e-95f0-235982559053 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-f6610662-cc95-4022-9336-3f269517077c req-85dea8df-d8b0-406e-95f0-235982559053 service nova] Creating event network-vif-plugged:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:29:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-f6610662-cc95-4022-9336-3f269517077c req-85dea8df-d8b0-406e-95f0-235982559053 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040677 Apr 20 05:29:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 29/84] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-c1fd59ad-d613-4b42-8169-ecab0c4160c7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Action: 'create', calling method: .version_select at 0x7ff302b60a60>, body: {"keypair": {"name": "tempest-keypair-546899264", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3UXWbnwd8yMpy3SavFMvGCUAbyoUCL0JIVYD9Kr+Dx8j7eVD797joQaFVTOYBY48onocMVrys4CYvlkuKgD5ntCy2FeTWBQ3mK5mwv6xEPZGXH6Y6+MqnCmomFPP5NgA=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-c1fd59ad-d613-4b42-8169-ecab0c4160c7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for project 25e3d8c4aae04740b98c807df5434a53. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:13 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-c1fd59ad-d613-4b42-8169-ecab0c4160c7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for user 4ef040bbdf0346b98a7816a6d0b02cdf and project 25e3d8c4aae04740b98c807df5434a53. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:13 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-c1fd59ad-d613-4b42-8169-ecab0c4160c7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.235539 Apr 20 05:29:13 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 27/85] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 05:29:13 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 05:29:13 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-27cb4998-33bf-4134-a028-97838b199b7d tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Action: 'create', calling method: .version_select at 0x7ff302c992d0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1419304051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZuaA21d8Xnyc0UbFG8MLJic/fo30gvvfsFPXjFXweq7fA7coXmmXGH8LAWcGKonW1ihiMTN9byCZ5jYQjUEC1GDYcn6X5VxHSUzTrJrQyMcfPhsDjlw0OAFxFTwDE6pQ=="}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:13 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-27cb4998-33bf-4134-a028-97838b199b7d tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Getting quotas for project 3d5cf3b44333417e9221dde77ba4becb. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:13 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-27cb4998-33bf-4134-a028-97838b199b7d tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Getting quotas for user 25a086c1dde540b194c70100b4ea61d9 and project 3d5cf3b44333417e9221dde77ba4becb. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:13 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-27cb4998-33bf-4134-a028-97838b199b7d tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.284051 Apr 20 05:29:13 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 30/86] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:29:13 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1378341212", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0ce9eb4b-2eb8-4368-9d6e-d2cab7b007b0"}], "security_groups": [{"name": "tempest-securitygroup--2142239933"}], "key_name": "tempest-keypair-546899264", "user_data": "}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] validate_networks() for [('0ce9eb4b-2eb8-4368-9d6e-d2cab7b007b0', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:29:15 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-405925125", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1419304051", "security_groups": [{"name": "tempest-secgroup-smoke-1152173561"}], "networks": [{"uuid": "e68675c0-45ef-4e3d-bb0c-05ab90754490"}]}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:15 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] validate_networks() for [('e68675c0-45ef-4e3d-bb0c-05ab90754490', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for project 25e3d8c4aae04740b98c807df5434a53. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for user 4ef040bbdf0346b98a7816a6d0b02cdf and project 25e3d8c4aae04740b98c807df5434a53. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:15 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:29:16 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:29:16 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-32253c53-6fb2-43ca-98d6-a575844eeaf7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.860496 Apr 20 05:29:16 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 30/87] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 05:29:15 2023] POST /compute/v2.1/servers => generated 400 bytes in 863 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5e5a0f1c-61b8-471b-a4b2-302de79d0a39 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5e5a0f1c-61b8-471b-a4b2-302de79d0a39 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-5e5a0f1c-61b8-471b-a4b2-302de79d0a39 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-5e5a0f1c-61b8-471b-a4b2-302de79d0a39 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-5e5a0f1c-61b8-471b-a4b2-302de79d0a39 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:16 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5e5a0f1c-61b8-471b-a4b2-302de79d0a39 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 200 len: 1275 microversion: 2.20 time: 0.129351 Apr 20 05:29:16 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 31/88] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:29:16 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 1275 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Getting quotas for project 3d5cf3b44333417e9221dde77ba4becb. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Getting quotas for user 25a086c1dde540b194c70100b4ea61d9 and project 3d5cf3b44333417e9221dde77ba4becb. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:29:16 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:29:16 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-ab39ceda-7059-47b9-8ca4-1570021a39aa tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.803763 Apr 20 05:29:16 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 28/89] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:29:15 2023] POST /compute/v2.1/servers => generated 404 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:29:16 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-39cf6119-481f-4696-8bc4-e9a07cb71a1c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:16 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-39cf6119-481f-4696-8bc4-e9a07cb71a1c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:16 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-39cf6119-481f-4696-8bc4-e9a07cb71a1c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a086c1dde540b194c70100b4ea61d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5cf3b44333417e9221dde77ba4becb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:16 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-39cf6119-481f-4696-8bc4-e9a07cb71a1c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e" status: 200 len: 1256 microversion: 2.1 time: 0.072884 Apr 20 05:29:16 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 31/90] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:16 2023] GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e => generated 1256 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:17 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-12e9741a-2d6d-41a9-a89e-ba0a262e0516 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1539 microversion: 2.1 time: 0.353312 Apr 20 05:29:17 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 32/91] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:16 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1539 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:19 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:19 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:19 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-64b8eda6-9121-4408-abd6-74fb7e8c1639 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41" status: 200 len: 1690 microversion: 2.87 time: 0.446204 Apr 20 05:29:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 33/92] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:29:18 2023] GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 => generated 1690 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-277e423e-743b-47a5-946c-d6e8608f97d6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1493 microversion: 2.1 time: 0.790626 Apr 20 05:29:19 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 29/93] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:18 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1493 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:19 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636e86cdf83e480595e4f0dba3bf8c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca4a6041fb3472ebfa953dff7ce031c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fa6084ab-2870-4e14-954e-d518589beec3 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899" status: 200 len: 1489 microversion: 2.1 time: 0.683767 Apr 20 05:29:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 32/94] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:18 2023] GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899 => generated 1489 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-524342415", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:19 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] validate_networks() for [('8a219902-6960-4bdc-afe9-004bd552cf70', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:20 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-5f3db33c-09d9-47f0-bb82-7fd541a7cb54 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 200 len: 1545 microversion: 2.1 time: 0.332683 Apr 20 05:29:20 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 30/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:19 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 1545 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-188c26b1-98d3-455e-9e9b-34c9708b0f76 req-7d9e5c2e-bc96-46e4-b99a-e92f88d2c8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83afcd8b-7577-4632-bc26-8ee4fbadeb6e", "tag": "0dc1c6c4-d2f1-4256-891b-14a5430ee9f8"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-188c26b1-98d3-455e-9e9b-34c9708b0f76 req-7d9e5c2e-bc96-46e4-b99a-e92f88d2c8de service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-188c26b1-98d3-455e-9e9b-34c9708b0f76 req-7d9e5c2e-bc96-46e4-b99a-e92f88d2c8de service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-188c26b1-98d3-455e-9e9b-34c9708b0f76 req-7d9e5c2e-bc96-46e4-b99a-e92f88d2c8de service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-188c26b1-98d3-455e-9e9b-34c9708b0f76 req-7d9e5c2e-bc96-46e4-b99a-e92f88d2c8de service nova] Creating event network-changed:0dc1c6c4-d2f1-4256-891b-14a5430ee9f8 for instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e on user Apr 20 05:29:20 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-188c26b1-98d3-455e-9e9b-34c9708b0f76 req-7d9e5c2e-bc96-46e4-b99a-e92f88d2c8de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053780 Apr 20 05:29:20 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 33/96] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:20 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-29a63426-0646-481c-979d-a3e5cff23933 req-3131cd36-6748-4957-a85d-e1a33f841351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-29a63426-0646-481c-979d-a3e5cff23933 req-3131cd36-6748-4957-a85d-e1a33f841351 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-29a63426-0646-481c-979d-a3e5cff23933 req-3131cd36-6748-4957-a85d-e1a33f841351 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-29a63426-0646-481c-979d-a3e5cff23933 req-3131cd36-6748-4957-a85d-e1a33f841351 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-29a63426-0646-481c-979d-a3e5cff23933 req-3131cd36-6748-4957-a85d-e1a33f841351 service nova] Creating event network-changed:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:29:20 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-29a63426-0646-481c-979d-a3e5cff23933 req-3131cd36-6748-4957-a85d-e1a33f841351 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030390 Apr 20 05:29:20 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 31/97] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:20 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1071a61ffe56426997058ad6c6a2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6404b98cd405456f8d4c275b72ef3d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:20 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-8fdab9c8-a223-4f24-88ec-551505ec2b83 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 200 len: 1536 microversion: 2.1 time: 0.266749 Apr 20 05:29:20 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 34/98] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:20 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 1536 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:21 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Getting quotas for project b3862eced3a047edbe7a341f7898896b. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:21 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Getting quotas for user 4215c58b1fbf42f9ba87364b3b4ec5cd and project b3862eced3a047edbe7a341f7898896b. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:21 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:29:21 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:29:21 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-b26b5883-1c54-49f0-8fee-26a533c04100 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.729519 Apr 20 05:29:21 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 34/99] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:29:19 2023] POST /compute/v2.1/servers => generated 381 bytes in 1731 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:29:21 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-52112e33-6a14-4412-b048-e9229b081b42 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:21 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-52112e33-6a14-4412-b048-e9229b081b42 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:21 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-52112e33-6a14-4412-b048-e9229b081b42 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:21 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-52112e33-6a14-4412-b048-e9229b081b42 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266" status: 200 len: 1215 microversion: 2.1 time: 0.072813 Apr 20 05:29:21 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 32/100] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:21 2023] GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1681394660", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] validate_networks() for [('8a219902-6960-4bdc-afe9-004bd552cf70', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:22 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Getting quotas for project b3862eced3a047edbe7a341f7898896b. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:22 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Getting quotas for user 4215c58b1fbf42f9ba87364b3b4ec5cd and project b3862eced3a047edbe7a341f7898896b. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:22 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:29:22 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:29:22 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-62dfa6e6-9d1a-4fd1-bf02-efbaaa28b8c7 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 0.741222 Apr 20 05:29:22 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 35/101] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:29:21 2023] POST /compute/v2.1/servers => generated 381 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:29:22 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-00edb099-5a8e-4363-84cb-69e89611b40f tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:22 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-00edb099-5a8e-4363-84cb-69e89611b40f tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:22 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-00edb099-5a8e-4363-84cb-69e89611b40f tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:22 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-00edb099-5a8e-4363-84cb-69e89611b40f tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 200 len: 1216 microversion: 2.1 time: 0.080228 Apr 20 05:29:22 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 35/102] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:22 2023] GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 1216 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:29:23 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-cea99a7e-d0c9-4005-a508-d84ca0a68af6 req-4616e56d-8d68-4678-9d3f-477514166d41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afcd8b-7577-4632-bc26-8ee4fbadeb6e", "name": "network-vif-plugged", "status": "completed", "tag": "0dc1c6c4-d2f1-4256-891b-14a5430ee9f8"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-cea99a7e-d0c9-4005-a508-d84ca0a68af6 req-4616e56d-8d68-4678-9d3f-477514166d41 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-cea99a7e-d0c9-4005-a508-d84ca0a68af6 req-4616e56d-8d68-4678-9d3f-477514166d41 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-cea99a7e-d0c9-4005-a508-d84ca0a68af6 req-4616e56d-8d68-4678-9d3f-477514166d41 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:23 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-cea99a7e-d0c9-4005-a508-d84ca0a68af6 req-4616e56d-8d68-4678-9d3f-477514166d41 service nova] Creating event network-vif-plugged:0dc1c6c4-d2f1-4256-891b-14a5430ee9f8 for instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e on user Apr 20 05:29:23 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-cea99a7e-d0c9-4005-a508-d84ca0a68af6 req-4616e56d-8d68-4678-9d3f-477514166d41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041169 Apr 20 05:29:23 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 33/103] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:24 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-7df8d13a-044b-422f-84cf-42328702ceaf req-bf48dfe8-76e0-4eca-8528-49f3a4bdc60d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "name": "network-vif-plugged", "status": "completed", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-7df8d13a-044b-422f-84cf-42328702ceaf req-bf48dfe8-76e0-4eca-8528-49f3a4bdc60d service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-7df8d13a-044b-422f-84cf-42328702ceaf req-bf48dfe8-76e0-4eca-8528-49f3a4bdc60d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-7df8d13a-044b-422f-84cf-42328702ceaf req-bf48dfe8-76e0-4eca-8528-49f3a4bdc60d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-7df8d13a-044b-422f-84cf-42328702ceaf req-bf48dfe8-76e0-4eca-8528-49f3a4bdc60d service nova] Creating event network-vif-plugged:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:29:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-7df8d13a-044b-422f-84cf-42328702ceaf req-bf48dfe8-76e0-4eca-8528-49f3a4bdc60d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032332 Apr 20 05:29:24 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 36/104] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:25 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-b8e954bc-9329-4fdd-9ed0-df47befa3293 req-d8a192d4-c58a-4ac7-a1e5-ab499a82b290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:25 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-22991e9a-ce0e-43ba-a404-638f76fe39aa req-8e15a6f1-c36f-4dfa-8dd9-5297cf643895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afcd8b-7577-4632-bc26-8ee4fbadeb6e", "name": "network-vif-plugged", "status": "completed", "tag": "0dc1c6c4-d2f1-4256-891b-14a5430ee9f8"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:25 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b8e954bc-9329-4fdd-9ed0-df47befa3293 req-d8a192d4-c58a-4ac7-a1e5-ab499a82b290 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:25 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b8e954bc-9329-4fdd-9ed0-df47befa3293 req-d8a192d4-c58a-4ac7-a1e5-ab499a82b290 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:25 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b8e954bc-9329-4fdd-9ed0-df47befa3293 req-d8a192d4-c58a-4ac7-a1e5-ab499a82b290 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:25 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-22991e9a-ce0e-43ba-a404-638f76fe39aa req-8e15a6f1-c36f-4dfa-8dd9-5297cf643895 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:25 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-22991e9a-ce0e-43ba-a404-638f76fe39aa req-8e15a6f1-c36f-4dfa-8dd9-5297cf643895 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:25 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-22991e9a-ce0e-43ba-a404-638f76fe39aa req-8e15a6f1-c36f-4dfa-8dd9-5297cf643895 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:25 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-22991e9a-ce0e-43ba-a404-638f76fe39aa req-8e15a6f1-c36f-4dfa-8dd9-5297cf643895 service nova] Creating event network-vif-plugged:0dc1c6c4-d2f1-4256-891b-14a5430ee9f8 for instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e on user Apr 20 05:29:25 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-22991e9a-ce0e-43ba-a404-638f76fe39aa req-8e15a6f1-c36f-4dfa-8dd9-5297cf643895 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032505 Apr 20 05:29:25 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-b8e954bc-9329-4fdd-9ed0-df47befa3293 req-d8a192d4-c58a-4ac7-a1e5-ab499a82b290 service nova] Creating event network-changed:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:29:25 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 34/105] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:25 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-b8e954bc-9329-4fdd-9ed0-df47befa3293 req-d8a192d4-c58a-4ac7-a1e5-ab499a82b290 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079155 Apr 20 05:29:25 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 36/106] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:26 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "name": "network-vif-plugged", "status": "completed", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}, {"name": "network-changed", "server_uuid": "be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266", "tag": "68089a37-5a59-462b-ab14-1fd2bc4d6eb4"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] Creating event network-vif-plugged:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:29:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] Creating event network-changed:68089a37-5a59-462b-ab14-1fd2bc4d6eb4 for instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 on user Apr 20 05:29:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-4ffbd250-549d-4041-b341-de158bb4d22d req-6e43dbbc-ef09-4f28-8d7b-3172b6ace553 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.055685 Apr 20 05:29:26 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 37/107] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:26 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:27 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266", "name": "network-vif-plugged", "status": "completed", "tag": "68089a37-5a59-462b-ab14-1fd2bc4d6eb4"}, {"server_uuid": "be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266", "name": "network-vif-plugged", "status": "completed", "tag": "68089a37-5a59-462b-ab14-1fd2bc4d6eb4"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:27 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] Creating event network-vif-plugged:68089a37-5a59-462b-ab14-1fd2bc4d6eb4 for instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 on user Apr 20 05:29:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] Creating event network-vif-plugged:68089a37-5a59-462b-ab14-1fd2bc4d6eb4 for instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 on user Apr 20 05:29:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-c0f15d4c-69f7-4871-9415-d381407a6b67 req-b795cf94-d1fa-426e-b27c-f24c3ac4b0e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069920 Apr 20 05:29:27 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 35/108] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:27 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:29 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}, {"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:29 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:29 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:29 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:29 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] Creating event network-vif-plugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:29:29 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] Creating event network-vif-plugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:29:29 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-122b38ce-aad7-4eda-b7ed-1c19133ed5ed req-1210f854-196c-4acd-95e7-3e1bd54491fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038753 Apr 20 05:29:29 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 37/109] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:29:29 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=14 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=26 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-2103f320-0c17-4661-917c-1c1059a3bb92 tempest-TestStampPattern-2020887667 tempest-TestStampPattern-2020887667-project-member] Action: 'create', calling method: .version_select at 0x7ff302cbc0d0>, body: {"keypair": {"name": "tempest-TestStampPattern-247548320", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdcEpYr8oB5wX6q5DbvctawGVcAlkmzfBfxQIrjpChTJXIcOOXPx8sydSIiGcd3LMhbdllRuuKj+ygiU+QBfLb3yyY6UYYvn21Nc+rTwbO12MpgFR1pEMLxGHqoo9kUtw=="}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-2103f320-0c17-4661-917c-1c1059a3bb92 tempest-TestStampPattern-2020887667 tempest-TestStampPattern-2020887667-project-member] Getting quotas for project 20ed8f2156d546c1a547f1317c6d44e0. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:29:40 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-2103f320-0c17-4661-917c-1c1059a3bb92 tempest-TestStampPattern-2020887667 tempest-TestStampPattern-2020887667-project-member] Getting quotas for user 23d9c7203d6e4c93a5852973c88227b2 and project 20ed8f2156d546c1a547f1317c6d44e0. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:29:40 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-2103f320-0c17-4661-917c-1c1059a3bb92 tempest-TestStampPattern-2020887667 tempest-TestStampPattern-2020887667-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.394290 Apr 20 05:29:40 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 38/110] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:29:40 2023] POST /compute/v2.1/os-keypairs => generated 394 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:29:43 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=12 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:43 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:43 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=22 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:43 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-a96f6e85-9aab-4496-8ea6-39299ee91d70 tempest-TestStampPattern-2020887667 tempest-TestStampPattern-2020887667-project-member] Calling method '.version_select at 0x7ff302b61ea0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:43 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-a96f6e85-9aab-4496-8ea6-39299ee91d70 tempest-TestStampPattern-2020887667 tempest-TestStampPattern-2020887667-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-247548320" status: 202 len: 0 microversion: 2.1 time: 0.043126 Apr 20 05:29:43 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 36/111] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:29:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-247548320 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=14 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=4 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=20 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:29:49 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afc1850f3ae430f92db6158f202fd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb217a867f47aab97360ef5dd2e98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:29:49 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-af0b7197-0c66-4dc9-b90a-e422d6ff61d2 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 200 len: 1549 microversion: 2.1 time: 0.219558 Apr 20 05:29:49 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 38/112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:29:49 2023] GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 1549 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:06 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:06 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-480a299c-a32c-46d4-be04-3b33d6d0ce3c tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 200 len: 1586 microversion: 2.20 time: 0.267122 Apr 20 05:30:06 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 39/113] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:30:06 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 1586 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:30:06 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a086c1dde540b194c70100b4ea61d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5cf3b44333417e9221dde77ba4becb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:06 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-46f35633-386c-42a1-954d-386d22c4d09b tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e" status: 200 len: 1568 microversion: 2.1 time: 0.234271 Apr 20 05:30:06 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 37/114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:06 2023] GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e => generated 1568 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:12 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-546fcd68-7355-4a38-b589-61a7810c4e28 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 200 len: 1503 microversion: 2.1 time: 0.226540 Apr 20 05:30:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 39/115] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:12 2023] GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 1503 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:17 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-ae0732d0-5a5b-41a0-ab03-0a9edfb99eea tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.203825 Apr 20 05:30:17 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:30:17 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd/os-interface => generated 283 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-9eec9101-e4ce-467b-9306-5deae4a0ce56 req-26604d47-c67f-4dc2-bdd0-0dea30971431 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:18 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:18 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9eec9101-e4ce-467b-9306-5deae4a0ce56 req-26604d47-c67f-4dc2-bdd0-0dea30971431 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9eec9101-e4ce-467b-9306-5deae4a0ce56 req-26604d47-c67f-4dc2-bdd0-0dea30971431 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9eec9101-e4ce-467b-9306-5deae4a0ce56 req-26604d47-c67f-4dc2-bdd0-0dea30971431 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:18 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-9eec9101-e4ce-467b-9306-5deae4a0ce56 req-26604d47-c67f-4dc2-bdd0-0dea30971431 service nova] Creating event network-changed:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:30:18 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-9eec9101-e4ce-467b-9306-5deae4a0ce56 req-26604d47-c67f-4dc2-bdd0-0dea30971431 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038447 Apr 20 05:30:18 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 38/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:18 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:18 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-dd433cd9-7439-40de-bf38-22517facfa1c tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1539 microversion: 2.1 time: 0.242618 Apr 20 05:30:18 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 40/118] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:18 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:18 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:18 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-544d0266-c676-4d48-892d-acfc3df1cbfc tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1539 microversion: 2.1 time: 0.357611 Apr 20 05:30:18 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 41/119] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:18 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1539 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-325424381"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1192884043", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "8922cf58-d9e1-424f-8aba-133b11372bf4"}]}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] validate_networks() for [('8922cf58-d9e1-424f-8aba-133b11372bf4', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Getting quotas for project 4e0e7a7d59fd49c3aaaedbf085980c96. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Getting quotas for user 198edaee95b0445b8cb018046d790576 and project 4e0e7a7d59fd49c3aaaedbf085980c96. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:30:19 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:30:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-c8117e7d-be49-4bb3-abad-a831e45622a8 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.593015 Apr 20 05:30:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 41/120] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:30:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:30:19 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a5edf7ab-b8db-421c-9fa2-a2f9e30a6eff tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:19 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-a5edf7ab-b8db-421c-9fa2-a2f9e30a6eff tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:19 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-a5edf7ab-b8db-421c-9fa2-a2f9e30a6eff tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-a5edf7ab-b8db-421c-9fa2-a2f9e30a6eff tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 200 len: 1211 microversion: 2.1 time: 0.066669 Apr 20 05:30:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 42/121] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:19 2023] GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 1211 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:20 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-53a52a78-be4c-4ee7-99d9-b3df1c2a307a tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41/action" status: 202 len: 52 microversion: 2.87 time: 1.162855 Apr 20 05:30:20 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 39/122] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 05:30:19 2023] POST /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41/action => generated 52 bytes in 1165 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 05:30:20 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-1c054b6f-ad2c-464f-bbbd-079fa8cc17e9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.222607 Apr 20 05:30:20 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:30:20 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524/os-interface => generated 282 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:20 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:30:20 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-c4a905e4-a737-4e55-834b-594d1f25d9bf tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899" status: 204 len: 0 microversion: 2.1 time: 0.127718 Apr 20 05:30:20 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 43/124] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:30:20 2023] DELETE /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:20 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:21 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-991fcb1c-d183-4956-a1e0-0f72ac67fa77 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.210326 Apr 20 05:30:21 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 43/125] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:30:21 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0/os-interface => generated 282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:21 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-30bd35f3-70e3-47f1-8dde-fcab23bedf35 req-776e0c7d-4233-451f-b4ca-f2a081f72b9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aa1ee3-10da-4e16-a5a9-75b2f6089899", "name": "network-vif-unplugged", "status": "completed", "tag": "ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-30bd35f3-70e3-47f1-8dde-fcab23bedf35 req-776e0c7d-4233-451f-b4ca-f2a081f72b9f service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-30bd35f3-70e3-47f1-8dde-fcab23bedf35 req-776e0c7d-4233-451f-b4ca-f2a081f72b9f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-30bd35f3-70e3-47f1-8dde-fcab23bedf35 req-776e0c7d-4233-451f-b4ca-f2a081f72b9f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-30bd35f3-70e3-47f1-8dde-fcab23bedf35 req-776e0c7d-4233-451f-b4ca-f2a081f72b9f service nova] Creating event network-vif-unplugged:ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5 for instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 on user Apr 20 05:30:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-30bd35f3-70e3-47f1-8dde-fcab23bedf35 req-776e0c7d-4233-451f-b4ca-f2a081f72b9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045524 Apr 20 05:30:21 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 44/126] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:21 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '636e86cdf83e480595e4f0dba3bf8c18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ca4a6041fb3472ebfa953dff7ce031c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:21 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-4ab7751f-15c4-4df9-a7ae-6f3aa0ed1a53 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899" status: 200 len: 1495 microversion: 2.1 time: 0.777652 Apr 20 05:30:21 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 40/127] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:20 2023] GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899 => generated 1495 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:21 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:21 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-9f885b02-0d71-49c0-a233-4cc389c4d196 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524/ips" status: 200 len: 108 microversion: 2.1 time: 0.054075 Apr 20 05:30:21 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 44/128] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:30:21 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524/ips => generated 108 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:22 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-72336e09-b5c9-40c5-a246-f7465e9a2372 req-0e7163a8-556b-4019-97b5-8333c9790bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:22 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-72336e09-b5c9-40c5-a246-f7465e9a2372 req-0e7163a8-556b-4019-97b5-8333c9790bd8 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:22 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-72336e09-b5c9-40c5-a246-f7465e9a2372 req-0e7163a8-556b-4019-97b5-8333c9790bd8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:22 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-72336e09-b5c9-40c5-a246-f7465e9a2372 req-0e7163a8-556b-4019-97b5-8333c9790bd8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:22 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-b2466214-f8b2-4954-a7d3-7c82cbfc5da1 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0/ips" status: 200 len: 104 microversion: 2.1 time: 0.037268 Apr 20 05:30:22 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 41/129] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:30:22 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0/ips => generated 104 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:22 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-83a8e2eb-346e-4ff4-a3f3-6aef95e1a444 req-89ec2abf-47d8-4944-ba76-314821930ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0156a5dd-1667-414e-bbaa-1980596b82e5", "tag": "fc5ee828-7d3b-404c-8847-dc95a54cea2e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:22 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-83a8e2eb-346e-4ff4-a3f3-6aef95e1a444 req-89ec2abf-47d8-4944-ba76-314821930ab1 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:22 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-83a8e2eb-346e-4ff4-a3f3-6aef95e1a444 req-89ec2abf-47d8-4944-ba76-314821930ab1 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:22 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-83a8e2eb-346e-4ff4-a3f3-6aef95e1a444 req-89ec2abf-47d8-4944-ba76-314821930ab1 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:22 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-83a8e2eb-346e-4ff4-a3f3-6aef95e1a444 req-89ec2abf-47d8-4944-ba76-314821930ab1 service nova] Creating event network-changed:fc5ee828-7d3b-404c-8847-dc95a54cea2e for instance 0156a5dd-1667-414e-bbaa-1980596b82e5 on user Apr 20 05:30:22 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-83a8e2eb-346e-4ff4-a3f3-6aef95e1a444 req-89ec2abf-47d8-4944-ba76-314821930ab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033095 Apr 20 05:30:22 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 45/130] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:22 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-72336e09-b5c9-40c5-a246-f7465e9a2372 req-0e7163a8-556b-4019-97b5-8333c9790bd8 service nova] Creating event network-changed:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:30:22 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-72336e09-b5c9-40c5-a246-f7465e9a2372 req-0e7163a8-556b-4019-97b5-8333c9790bd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.242911 Apr 20 05:30:22 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 45/131] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:23 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:30:23 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "tag": "b831830b-a235-411f-857f-00c256b1be91"}, {"server_uuid": "06aa1ee3-10da-4e16-a5a9-75b2f6089899", "name": "network-vif-plugged", "status": "completed", "tag": "ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] Creating event network-changed:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:30:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] Creating event network-vif-plugged:ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5 for instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 on user Apr 20 05:30:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-fa5deab0-5ea8-4967-88cb-015f3c90bcc5 req-62d99990-6bb1-44ef-bf16-208e4c40a2d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.040004 Apr 20 05:30:23 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-374e65d5-ac7a-4fc8-a117-fc9e8e86373d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 204 len: 0 microversion: 2.1 time: 0.177959 Apr 20 05:30:23 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 42/132] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:30:23 2023] DELETE /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:30:23 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 46/133] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:23 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:23 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b60f22af-0516-422b-b76b-e6d4a4904a98 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 200 len: 1551 microversion: 2.1 time: 0.268807 Apr 20 05:30:23 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 46/134] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:23 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 1551 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:30:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-a77d67c6-0c98-41ef-83c4-762f2186ce3d tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 204 len: 0 microversion: 2.1 time: 0.158541 Apr 20 05:30:24 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 43/135] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:30:24 2023] DELETE /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:24 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1071a61ffe56426997058ad6c6a2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6404b98cd405456f8d4c275b72ef3d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:24 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-e2d3f3f6-7e91-4daf-9ae2-6a3b8ca21369 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 200 len: 1660 microversion: 2.1 time: 0.220456 Apr 20 05:30:24 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 47/136] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:24 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 1660 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:24 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "name": "network-vif-unplugged", "status": "completed", "tag": "b831830b-a235-411f-857f-00c256b1be91"}, {"server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "name": "network-vif-plugged", "status": "completed", "tag": "b831830b-a235-411f-857f-00c256b1be91"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] Creating event network-vif-unplugged:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:30:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] Creating event network-vif-plugged:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:30:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-32cd2ec5-0c85-4ffd-8f34-67969807aed1 req-8fbaa30c-08d4-4d69-a82b-8d99946fe698 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047636 Apr 20 05:30:24 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 47/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06aa1ee3-10da-4e16-a5a9-75b2f6089899", "name": "network-vif-deleted", "tag": "ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5"}, {"server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "name": "network-vif-unplugged", "status": "completed", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] Creating event network-vif-deleted:ddb814e0-b6b4-4a28-be57-2aaa0ecc12c5 for instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 on user Apr 20 05:30:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] Creating event network-vif-unplugged:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:30:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-c884c254-22a6-479d-9898-8112a3fc755d req-85af733e-7f6b-4e92-861c-e8a3eb1cf067 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034558 Apr 20 05:30:24 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 44/138] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:26 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:26 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-822b174e-452f-4bba-a1bc-13bab044c085 req-c815bb44-2b1e-4cc6-8cd0-4f7e0cb6237c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78d63d1a-6a1d-4691-8560-1ec596d47524", "name": "network-vif-deleted", "tag": "b831830b-a235-411f-857f-00c256b1be91"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-822b174e-452f-4bba-a1bc-13bab044c085 req-c815bb44-2b1e-4cc6-8cd0-4f7e0cb6237c service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-822b174e-452f-4bba-a1bc-13bab044c085 req-c815bb44-2b1e-4cc6-8cd0-4f7e0cb6237c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-822b174e-452f-4bba-a1bc-13bab044c085 req-c815bb44-2b1e-4cc6-8cd0-4f7e0cb6237c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-822b174e-452f-4bba-a1bc-13bab044c085 req-c815bb44-2b1e-4cc6-8cd0-4f7e0cb6237c service nova] Creating event network-vif-deleted:b831830b-a235-411f-857f-00c256b1be91 for instance 78d63d1a-6a1d-4691-8560-1ec596d47524 on user Apr 20 05:30:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-822b174e-452f-4bba-a1bc-13bab044c085 req-c815bb44-2b1e-4cc6-8cd0-4f7e0cb6237c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030116 Apr 20 05:30:26 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 48/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:27 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "name": "network-vif-plugged", "status": "completed", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}, {"server_uuid": "0156a5dd-1667-414e-bbaa-1980596b82e5", "name": "network-vif-plugged", "status": "completed", "tag": "fc5ee828-7d3b-404c-8847-dc95a54cea2e"}, {"server_uuid": "0156a5dd-1667-414e-bbaa-1980596b82e5", "name": "network-vif-plugged", "status": "completed", "tag": "fc5ee828-7d3b-404c-8847-dc95a54cea2e"}, {"server_uuid": "d5698511-ae0b-4340-a5bb-6a19a9c17dd0", "name": "network-vif-deleted", "tag": "432d95b7-22e4-4c17-b27f-ab25f1ecb6a3"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Creating event network-vif-plugged:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:30:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Creating event network-vif-plugged:fc5ee828-7d3b-404c-8847-dc95a54cea2e for instance 0156a5dd-1667-414e-bbaa-1980596b82e5 on user Apr 20 05:30:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Creating event network-vif-plugged:fc5ee828-7d3b-404c-8847-dc95a54cea2e for instance 0156a5dd-1667-414e-bbaa-1980596b82e5 on user Apr 20 05:30:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] Creating event network-vif-deleted:432d95b7-22e4-4c17-b27f-ab25f1ecb6a3 for instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 on user Apr 20 05:30:27 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-56779c0c-aa92-45d0-92fb-5a1c17982fa2 req-b5191734-6b40-4f44-ad43-540a1523301b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.051512 Apr 20 05:30:27 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 45/140] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:27 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:27 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:27 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-8d905ded-d8a4-48b0-bcb4-a209c1620803 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41" status: 200 len: 1690 microversion: 2.87 time: 0.523833 Apr 20 05:30:27 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 48/141] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:30:26 2023] GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 => generated 1690 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:49 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-61da943e-a3d5-4ed8-86a8-11630e964592 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.208364 Apr 20 05:30:49 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 49/142] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:30:49 2023] GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d/os-interface => generated 282 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:50 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:50 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:50 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-2a2f63b9-ea00-432e-b1e9-b198f8ff9f56 req-d4ffd928-81a1-4d0b-bfea-52e531fbf833 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:50 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-2a2f63b9-ea00-432e-b1e9-b198f8ff9f56 req-d4ffd928-81a1-4d0b-bfea-52e531fbf833 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:50 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-2a2f63b9-ea00-432e-b1e9-b198f8ff9f56 req-d4ffd928-81a1-4d0b-bfea-52e531fbf833 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:50 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-2a2f63b9-ea00-432e-b1e9-b198f8ff9f56 req-d4ffd928-81a1-4d0b-bfea-52e531fbf833 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:50 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-2a2f63b9-ea00-432e-b1e9-b198f8ff9f56 req-d4ffd928-81a1-4d0b-bfea-52e531fbf833 service nova] Creating event network-changed:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:30:50 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-2a2f63b9-ea00-432e-b1e9-b198f8ff9f56 req-d4ffd928-81a1-4d0b-bfea-52e531fbf833 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048431 Apr 20 05:30:50 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 46/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=42 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:52 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:30:52 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-ac10bdf4-4980-4410-b507-e62e54bd2bb4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 204 len: 0 microversion: 2.1 time: 0.138542 Apr 20 05:30:52 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 49/144] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:30:52 2023] DELETE /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:52 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8afc1850f3ae430f92db6158f202fd21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3acb217a867f47aab97360ef5dd2e98c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:30:52 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-fb7695df-363b-46ae-835b-e2fea3c6e16b tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 200 len: 1674 microversion: 2.1 time: 0.161054 Apr 20 05:30:52 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 50/145] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:30:52 2023] GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:30:52 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-4cbfeecb-54ee-458e-8a11-ed9e18dba764 req-a6d6ccb4-d6ef-4237-8962-26e068f4946c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "name": "network-vif-unplugged", "status": "completed", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-4cbfeecb-54ee-458e-8a11-ed9e18dba764 req-a6d6ccb4-d6ef-4237-8962-26e068f4946c service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-4cbfeecb-54ee-458e-8a11-ed9e18dba764 req-a6d6ccb4-d6ef-4237-8962-26e068f4946c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-4cbfeecb-54ee-458e-8a11-ed9e18dba764 req-a6d6ccb4-d6ef-4237-8962-26e068f4946c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:52 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-4cbfeecb-54ee-458e-8a11-ed9e18dba764 req-a6d6ccb4-d6ef-4237-8962-26e068f4946c service nova] Creating event network-vif-unplugged:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:30:52 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-4cbfeecb-54ee-458e-8a11-ed9e18dba764 req-a6d6ccb4-d6ef-4237-8962-26e068f4946c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028233 Apr 20 05:30:52 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 47/146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:53 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-1f8ae65a-1a4d-415b-b109-42e5d14face3 req-a4c102ff-674c-4961-a71a-968a266fc775 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "name": "network-vif-deleted", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-1f8ae65a-1a4d-415b-b109-42e5d14face3 req-a4c102ff-674c-4961-a71a-968a266fc775 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-1f8ae65a-1a4d-415b-b109-42e5d14face3 req-a4c102ff-674c-4961-a71a-968a266fc775 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-1f8ae65a-1a4d-415b-b109-42e5d14face3 req-a4c102ff-674c-4961-a71a-968a266fc775 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:54 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-1f8ae65a-1a4d-415b-b109-42e5d14face3 req-a4c102ff-674c-4961-a71a-968a266fc775 service nova] Creating event network-vif-deleted:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:30:54 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-1f8ae65a-1a4d-415b-b109-42e5d14face3 req-a4c102ff-674c-4961-a71a-968a266fc775 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047809 Apr 20 05:30:54 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:30:54 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-e498b3c1-8f1a-4620-9eda-d7e4e44c0570 req-a046b055-1b8b-42c5-9b58-48fdce910b01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b9dfc9e-e473-46cb-9963-2ba47fcfad5d", "name": "network-vif-plugged", "status": "completed", "tag": "1c98d5eb-fde4-4a13-a521-0a3f704fce3e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:30:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-e498b3c1-8f1a-4620-9eda-d7e4e44c0570 req-a046b055-1b8b-42c5-9b58-48fdce910b01 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:30:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-e498b3c1-8f1a-4620-9eda-d7e4e44c0570 req-a046b055-1b8b-42c5-9b58-48fdce910b01 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:30:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-e498b3c1-8f1a-4620-9eda-d7e4e44c0570 req-a046b055-1b8b-42c5-9b58-48fdce910b01 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:30:54 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-e498b3c1-8f1a-4620-9eda-d7e4e44c0570 req-a046b055-1b8b-42c5-9b58-48fdce910b01 service nova] Creating event network-vif-plugged:1c98d5eb-fde4-4a13-a521-0a3f704fce3e for instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d on user Apr 20 05:30:54 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-e498b3c1-8f1a-4620-9eda-d7e4e44c0570 req-a046b055-1b8b-42c5-9b58-48fdce910b01 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028934 Apr 20 05:30:54 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 51/148] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:30:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=4 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=4 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:06 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-2ccaeb61-db5f-4561-9116-9200b0c7f17e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.167066 Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:06 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 48/149] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 05:31:06 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a/os-interface => generated 282 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:07 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a086c1dde540b194c70100b4ea61d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5cf3b44333417e9221dde77ba4becb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-49ad4173-cd2f-4670-ab2e-be58f2f4ec2c tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e" status: 200 len: 1568 microversion: 2.1 time: 0.264173 Apr 20 05:31:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 51/150] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:06 2023] GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e => generated 1568 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:07 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:07 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=12 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:07 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-6c18ae1c-a757-46f7-b0fe-7ab38e670450 req-7af91bf0-1948-4ed5-bc58-d100a3eacdee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-6c18ae1c-a757-46f7-b0fe-7ab38e670450 req-7af91bf0-1948-4ed5-bc58-d100a3eacdee service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-6c18ae1c-a757-46f7-b0fe-7ab38e670450 req-7af91bf0-1948-4ed5-bc58-d100a3eacdee service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-6c18ae1c-a757-46f7-b0fe-7ab38e670450 req-7af91bf0-1948-4ed5-bc58-d100a3eacdee service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:07 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-6c18ae1c-a757-46f7-b0fe-7ab38e670450 req-7af91bf0-1948-4ed5-bc58-d100a3eacdee service nova] Creating event network-changed:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:31:07 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-6c18ae1c-a757-46f7-b0fe-7ab38e670450 req-7af91bf0-1948-4ed5-bc58-d100a3eacdee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038030 Apr 20 05:31:07 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 52/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:07 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d0b76c38-7de1-4f46-aee0-3be5ae2dcf12 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a/ips" status: 200 len: 109 microversion: 2.20 time: 0.034895 Apr 20 05:31:07 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 49/152] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 05:31:07 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a/ips => generated 109 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:08 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:31:08 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-383dfd6c-0a97-44dd-b75a-162a553a7f37 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e" status: 204 len: 0 microversion: 2.1 time: 0.118158 Apr 20 05:31:08 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:31:08 2023] DELETE /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:08 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:08 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '25a086c1dde540b194c70100b4ea61d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5cf3b44333417e9221dde77ba4becb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-1ced619a-6ed0-46b7-92eb-11e88634b615 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e" status: 200 len: 1574 microversion: 2.1 time: 0.371975 Apr 20 05:31:09 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 53/154] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:08 2023] GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e => generated 1574 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:31:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-0c8e8f53-959a-4367-b166-ebd0f68f1f55 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 204 len: 0 microversion: 2.20 time: 0.121833 Apr 20 05:31:09 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 53/155] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:31:09 2023] DELETE /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-41296af5-a132-44fe-ad81-e06f4be4604a req-d8860a35-cffc-46c6-92f0-1cda5cf99dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "name": "network-vif-unplugged", "status": "completed", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-41296af5-a132-44fe-ad81-e06f4be4604a req-d8860a35-cffc-46c6-92f0-1cda5cf99dcd service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-41296af5-a132-44fe-ad81-e06f4be4604a req-d8860a35-cffc-46c6-92f0-1cda5cf99dcd service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-41296af5-a132-44fe-ad81-e06f4be4604a req-d8860a35-cffc-46c6-92f0-1cda5cf99dcd service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-41296af5-a132-44fe-ad81-e06f4be4604a req-d8860a35-cffc-46c6-92f0-1cda5cf99dcd service nova] Creating event network-vif-unplugged:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:31:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-41296af5-a132-44fe-ad81-e06f4be4604a req-d8860a35-cffc-46c6-92f0-1cda5cf99dcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035984 Apr 20 05:31:09 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 54/156] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-cdec23c5-3f32-4132-b352-a4571e69b927 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.571545 Apr 20 05:31:09 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 50/157] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:08 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-a78a4fbf-4c54-469c-af9e-be8d51195247 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 200 len: 1711 microversion: 2.20 time: 0.415815 Apr 20 05:31:09 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 54/158] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:31:09 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 1711 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-8d919935-47ce-4a9c-9d59-9b445af67977 req-3d4602b3-1141-4748-b163-267587c17430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afcd8b-7577-4632-bc26-8ee4fbadeb6e", "name": "network-vif-unplugged", "status": "completed", "tag": "0dc1c6c4-d2f1-4256-891b-14a5430ee9f8"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8d919935-47ce-4a9c-9d59-9b445af67977 req-3d4602b3-1141-4748-b163-267587c17430 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8d919935-47ce-4a9c-9d59-9b445af67977 req-3d4602b3-1141-4748-b163-267587c17430 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8d919935-47ce-4a9c-9d59-9b445af67977 req-3d4602b3-1141-4748-b163-267587c17430 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-8d919935-47ce-4a9c-9d59-9b445af67977 req-3d4602b3-1141-4748-b163-267587c17430 service nova] Creating event network-vif-unplugged:0dc1c6c4-d2f1-4256-891b-14a5430ee9f8 for instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e on user Apr 20 05:31:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-8d919935-47ce-4a9c-9d59-9b445af67977 req-3d4602b3-1141-4748-b163-267587c17430 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034807 Apr 20 05:31:09 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 51/159] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:10 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-ffc00fab-1926-4819-aac4-b99fdadf364a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 200 len: 1494 microversion: 2.1 time: 0.199027 Apr 20 05:31:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 55/160] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:10 2023] GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 1494 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:10 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:10 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-aec48115-ca51-45db-be89-e48b0ebbcbaa tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.704854 Apr 20 05:31:10 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 55/161] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:09 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:10 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-d05254cb-a4d6-4bb6-892c-5304676622f0 req-7dfae3cd-c4eb-44b6-b982-736dd746e992 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afcd8b-7577-4632-bc26-8ee4fbadeb6e", "name": "network-vif-deleted", "tag": "0dc1c6c4-d2f1-4256-891b-14a5430ee9f8"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-d05254cb-a4d6-4bb6-892c-5304676622f0 req-7dfae3cd-c4eb-44b6-b982-736dd746e992 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-d05254cb-a4d6-4bb6-892c-5304676622f0 req-7dfae3cd-c4eb-44b6-b982-736dd746e992 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-d05254cb-a4d6-4bb6-892c-5304676622f0 req-7dfae3cd-c4eb-44b6-b982-736dd746e992 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-d05254cb-a4d6-4bb6-892c-5304676622f0 req-7dfae3cd-c4eb-44b6-b982-736dd746e992 service nova] Creating event network-vif-deleted:0dc1c6c4-d2f1-4256-891b-14a5430ee9f8 for instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e on user Apr 20 05:31:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-d05254cb-a4d6-4bb6-892c-5304676622f0 req-7dfae3cd-c4eb-44b6-b982-736dd746e992 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033824 Apr 20 05:31:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 52/162] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:11 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "name": "network-vif-plugged", "status": "completed", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}, {"server_uuid": "5840d3e8-bf88-40d9-a864-03fb8c090e1a", "name": "network-vif-deleted", "tag": "3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] Creating event network-vif-plugged:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:31:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] Creating event network-vif-deleted:3a0a039b-b5e2-4cff-a2c4-4e01e4cd15f4 for instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a on user Apr 20 05:31:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-44d192e4-9c71-4ec6-8dd0-cd1b4992de28 req-bc17d8be-7fb8-404f-9d2f-f9bb2c98ce67 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031163 Apr 20 05:31:11 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 56/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:11 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-4e04dd5a-c6dc-4441-b5f8-b5cd8290b8d1 req-880b7b7d-1036-49e8-ba05-a3f9f6d5b6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83afcd8b-7577-4632-bc26-8ee4fbadeb6e", "name": "network-vif-plugged", "status": "completed", "tag": "0dc1c6c4-d2f1-4256-891b-14a5430ee9f8"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-4e04dd5a-c6dc-4441-b5f8-b5cd8290b8d1 req-880b7b7d-1036-49e8-ba05-a3f9f6d5b6d4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-4e04dd5a-c6dc-4441-b5f8-b5cd8290b8d1 req-880b7b7d-1036-49e8-ba05-a3f9f6d5b6d4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-4e04dd5a-c6dc-4441-b5f8-b5cd8290b8d1 req-880b7b7d-1036-49e8-ba05-a3f9f6d5b6d4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:11 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-4e04dd5a-c6dc-4441-b5f8-b5cd8290b8d1 req-880b7b7d-1036-49e8-ba05-a3f9f6d5b6d4 service nova] Creating event network-vif-plugged:0dc1c6c4-d2f1-4256-891b-14a5430ee9f8 for instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e on user Apr 20 05:31:11 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-4e04dd5a-c6dc-4441-b5f8-b5cd8290b8d1 req-880b7b7d-1036-49e8-ba05-a3f9f6d5b6d4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035607 Apr 20 05:31:11 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 56/164] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] [instance: 06aa1ee3-10da-4e16-a5a9-75b2f6089899] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:11 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] HTTP exception thrown: Instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 could not be found. Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Request method failure captured: Apr 20 05:31:11 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899 HTTP/1.1 Apr 20 05:31:11 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:31:11 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:31:11 user devstack@n-api.service[72598]: Connection: close Apr 20 05:31:11 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:31:11 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:31:11 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:31:11 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:31:11 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM14xB5p8tGtSXOs6fvl8t7G22b9ZPvM3UgCCZQhY7oceZnxJVMY9HB62sCi23uohah50orGdc0W64rB2Ecuhj7hw4awXNTQ40KnErT3LZ3R6NJnAYe91vdwVbF9hg7s2Fu7Y5M0q9SaGZAW7UEPE69nklW5tio-TKzq3R7eBtI-p44 Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Project-Id: 4ca4a6041fb3472ebfa953dff7ce031c Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Project-Name: tempest-DeleteServersTestJSON-1664258365 Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ca4a6041fb3472ebfa953dff7ce031c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4ca4a6041fb3472ebfa953dff7ce031c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4ca4a6041fb3472ebfa953dff7ce031c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Tenant: tempest-DeleteServersTestJSON-1664258365 Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Tenant-Id: 4ca4a6041fb3472ebfa953dff7ce031c Apr 20 05:31:11 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-DeleteServersTestJSON-1664258365 Apr 20 05:31:11 user devstack@n-api.service[72598]: X-User: tempest-DeleteServersTestJSON-1664258365-project-member Apr 20 05:31:11 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:31:11 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:31:11 user devstack@n-api.service[72598]: X-User-Id: 636e86cdf83e480595e4f0dba3bf8c18 Apr 20 05:31:11 user devstack@n-api.service[72598]: X-User-Name: tempest-DeleteServersTestJSON-1664258365-project-member Apr 20 05:31:11 user devstack@n-api.service[72598]: method: > Apr 20 05:31:11 user devstack@n-api.service[72598]: exception: Instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 could not be found. Apr 20 05:31:11 user devstack@n-api.service[72598]: action_args: {'id': '06aa1ee3-10da-4e16-a5a9-75b2f6089899'} Apr 20 05:31:11 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 could not be found. Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 could not be found. Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 could not be found. Apr 20 05:31:11 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:11 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] Returning 404 to user: Instance 06aa1ee3-10da-4e16-a5a9-75b2f6089899 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:11 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-317fa5e5-5307-48a9-bda7-0a6d747a6721 tempest-DeleteServersTestJSON-1664258365 tempest-DeleteServersTestJSON-1664258365-project-member] 10.0.0.210 "GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899" status: 404 len: 111 microversion: 2.1 time: 0.036026 Apr 20 05:31:11 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 53/165] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:11 2023] GET /compute/v2.1/servers/06aa1ee3-10da-4e16-a5a9-75b2f6089899 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:12 user devstack@n-api.service[72596]: DEBUG nova.objects.instance [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lazy-loading 'flavor' on Instance uuid ab7a2c49-e524-4472-82c7-5046bd66d9b3 {{(pid=72596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 05:31:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-bfb12ebd-20e0-4f92-a7af-8e0c5f7092f2 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "POST /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3/action" status: 200 len: 32 microversion: 2.1 time: 0.148698 Apr 20 05:31:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 57/166] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 05:31:12 2023] POST /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3/action => generated 32 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:13 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:13 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a5d77d5f-ba4f-4c8d-ae1b-51b861dfd5d8 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 200 len: 1509 microversion: 2.1 time: 0.362694 Apr 20 05:31:13 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:12 2023] GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 1509 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:13 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-8d61cba3-642b-4296-b5e6-67b1a4087bc4 req-7a033760-a3b6-498a-8794-d6a496a46514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:13 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8d61cba3-642b-4296-b5e6-67b1a4087bc4 req-7a033760-a3b6-498a-8794-d6a496a46514 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:13 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8d61cba3-642b-4296-b5e6-67b1a4087bc4 req-7a033760-a3b6-498a-8794-d6a496a46514 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:13 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8d61cba3-642b-4296-b5e6-67b1a4087bc4 req-7a033760-a3b6-498a-8794-d6a496a46514 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:13 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-8d61cba3-642b-4296-b5e6-67b1a4087bc4 req-7a033760-a3b6-498a-8794-d6a496a46514 service nova] Creating event network-vif-unplugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:31:13 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-8d61cba3-642b-4296-b5e6-67b1a4087bc4 req-7a033760-a3b6-498a-8794-d6a496a46514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030192 Apr 20 05:31:13 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 54/168] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:14 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:31:14 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 HTTP/1.1 Apr 20 05:31:14 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:31:14 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:31:14 user devstack@n-api.service[72596]: Connection: close Apr 20 05:31:14 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:31:14 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:31:14 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:31:14 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:31:14 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:31:14 user devstack@n-api.service[72596]: method: > Apr 20 05:31:14 user devstack@n-api.service[72596]: exception: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: action_args: {'id': '78d63d1a-6a1d-4691-8560-1ec596d47524'} Apr 20 05:31:14 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:14 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b50a4477-8794-4154-84b4-d27ec7fb6a88 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 404 len: 111 microversion: 2.1 time: 0.052215 Apr 20 05:31:14 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 58/169] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:13 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:14 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-29539cf4-2101-4d22-8f79-38ca3ede5f27 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '.version_select at 0x7ff302be12d0>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:14 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-29539cf4-2101-4d22-8f79-38ca3ede5f27 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-296371510" status: 202 len: 0 microversion: 2.1 time: 0.024421 Apr 20 05:31:14 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 58/170] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 05:31:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-296371510 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:31:14 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-266a9ceb-0e97-4eff-abc6-7226e91dac28 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Action: 'create', calling method: .version_select at 0x7ff3029a5870>, body: {"keypair": {"name": "tempest-keypair-2040957283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMn8MmjhUSsDHf1X/+ojqFLpS1DK/g4/q5/SW98pV9164sL+XaWIpkepoaNNLDLjUbrosJSfrQoxuJIKXWoSj/ecqfkXWie1dcF966FxHp+nKSYbTFDLXzFNTL5Mj1wj/w=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:14 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-266a9ceb-0e97-4eff-abc6-7226e91dac28 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for project c1069c90da8244529aca2b5907e46691. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:31:14 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-266a9ceb-0e97-4eff-abc6-7226e91dac28 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for user 1558ef8ec15f4bcaa4d8a73bf3b457bc and project c1069c90da8244529aca2b5907e46691. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-266a9ceb-0e97-4eff-abc6-7226e91dac28 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044724 Apr 20 05:31:14 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 55/171] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:31:14 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:14 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] HTTP exception thrown: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Request method failure captured: Apr 20 05:31:14 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 HTTP/1.1 Apr 20 05:31:14 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:31:14 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:31:14 user devstack@n-api.service[72596]: Connection: close Apr 20 05:31:14 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:31:14 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:31:14 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:31:14 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:31:14 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1zuBuFhkx5P0VD9mMlJcHEJ68FqQ7vC8NpNFcl0z6ib2M5hR2ktT4HktMQBNHP-iv3YNL2ILHEq9LsXFadGgivuiCsY7XyN27kdfFiNq07zl7jFKuEGCgAntszWJmOvQo-rclpjO1lRmfSVBxy_0aF4IKZEDm3SLgffWLUj9-iVyc Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Tenant-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Id: 1071a61ffe56426997058ad6c6a2c486 Apr 20 05:31:14 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:31:14 user devstack@n-api.service[72596]: method: > Apr 20 05:31:14 user devstack@n-api.service[72596]: exception: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: action_args: {'id': 'd5698511-ae0b-4340-a5bb-6a19a9c17dd0'} Apr 20 05:31:14 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:31:14 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:14 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Returning 404 to user: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:14 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-706af2cf-a207-4cc7-bc6b-4d54f17d64e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 404 len: 111 microversion: 2.1 time: 0.041970 Apr 20 05:31:14 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 59/172] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:14 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:14 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-e79bbe3c-74a9-4872-9350-c3d34e311165 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '.version_select at 0x7ff302acd6c0>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:14 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-e79bbe3c-74a9-4872-9350-c3d34e311165 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-532733036" status: 202 len: 0 microversion: 2.1 time: 0.042294 Apr 20 05:31:14 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 59/173] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 05:31:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-532733036 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:31:15 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-1605f2dd-29cb-455e-8aa6-d38e13cd00e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Action: 'create', calling method: .version_select at 0x7ff3029a5e10>, body: {"keypair": {"name": "tempest-keypair-422048262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBjv7WKrsiRgRqtSwmDpJOuGQsnF0LFipbQNpI56J1b8cekle5BnhPtF+0+6yavD9ljGnQ/StVLqgFRhIdu6N7LUC7Oz11WZBUI+O965TgbuRBuTXJejCdSbfF8FZhjrMg=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:15 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-1605f2dd-29cb-455e-8aa6-d38e13cd00e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:31:15 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-1605f2dd-29cb-455e-8aa6-d38e13cd00e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for user 1071a61ffe56426997058ad6c6a2c486 and project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:31:15 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-1605f2dd-29cb-455e-8aa6-d38e13cd00e2 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055184 Apr 20 05:31:15 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 56/174] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:31:15 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:15 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}, {"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:15 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] Creating event network-vif-plugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:31:15 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] Creating event network-vif-plugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:31:15 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-58ee3ecd-9b14-422b-b929-b29139606ce6 req-b153feb9-67d7-47cc-9f98-1fa735040b25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035868 Apr 20 05:31:15 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 60/175] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:15 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-878663470", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "095a8a82-6992-4f8a-b50b-f67a659d9247"}], "security_groups": [{"name": "tempest-securitygroup--1538071153"}], "key_name": "tempest-keypair-2040957283", "user_data": "}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] validate_networks() for [('095a8a82-6992-4f8a-b50b-f67a659d9247', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for project c1069c90da8244529aca2b5907e46691. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for user 1558ef8ec15f4bcaa4d8a73bf3b457bc and project c1069c90da8244529aca2b5907e46691. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:31:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-ad3133c3-119e-474d-b577-1fa3b475cda8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.616605 Apr 20 05:31:17 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 60/176] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:31:16 2023] POST /compute/v2.1/servers => generated 400 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:31:17 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-e5d43f97-eb4c-4baf-a18a-4a4c2fac21fd tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:17 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-e5d43f97-eb4c-4baf-a18a-4a4c2fac21fd tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:17 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-e5d43f97-eb4c-4baf-a18a-4a4c2fac21fd tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:17 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-e5d43f97-eb4c-4baf-a18a-4a4c2fac21fd tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 200 len: 1235 microversion: 2.1 time: 0.066040 Apr 20 05:31:17 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 57/177] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:17 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1344327051", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "37fb57c1-9e9d-4bc4-8dfb-6377c6d9ff4a"}], "security_groups": [{"name": "tempest-securitygroup--660371777"}], "key_name": "tempest-keypair-422048262", "user_data": "}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] validate_networks() for [('37fb57c1-9e9d-4bc4-8dfb-6377c6d9ff4a', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-56b1793f-5c6d-4d6b-9b9a-9114e97d3999 req-e938c80e-900f-4735-8078-a6e52cb00bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-56b1793f-5c6d-4d6b-9b9a-9114e97d3999 req-e938c80e-900f-4735-8078-a6e52cb00bc0 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-56b1793f-5c6d-4d6b-9b9a-9114e97d3999 req-e938c80e-900f-4735-8078-a6e52cb00bc0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:17 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-56b1793f-5c6d-4d6b-9b9a-9114e97d3999 req-e938c80e-900f-4735-8078-a6e52cb00bc0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-56b1793f-5c6d-4d6b-9b9a-9114e97d3999 req-e938c80e-900f-4735-8078-a6e52cb00bc0 service nova] Creating event network-vif-plugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:31:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-56b1793f-5c6d-4d6b-9b9a-9114e97d3999 req-e938c80e-900f-4735-8078-a6e52cb00bc0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039739 Apr 20 05:31:17 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 61/178] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Getting quotas for user 1071a61ffe56426997058ad6c6a2c486 and project 6404b98cd405456f8d4c275b72ef3d94. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:31:17 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:31:18 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-4b084d69-59f0-4e8f-b454-b2cd80f8ffc9 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.651902 Apr 20 05:31:18 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 61/179] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:31:17 2023] POST /compute/v2.1/servers => generated 399 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:31:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-36973222-fcef-4a5c-8e78-3c61e68f6471 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-36973222-fcef-4a5c-8e78-3c61e68f6471 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:18 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-36973222-fcef-4a5c-8e78-3c61e68f6471 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1071a61ffe56426997058ad6c6a2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6404b98cd405456f8d4c275b72ef3d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:18 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-36973222-fcef-4a5c-8e78-3c61e68f6471 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 200 len: 1231 microversion: 2.1 time: 0.070702 Apr 20 05:31:18 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 58/180] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:18 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 1231 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:31:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-c77ad55f-1eeb-44ca-b392-c38177f71167 req-b0718ff2-1fe0-42f8-95ef-103e519fdbda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "tag": "d072d509-898e-4552-994c-060638df5951"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c77ad55f-1eeb-44ca-b392-c38177f71167 req-b0718ff2-1fe0-42f8-95ef-103e519fdbda service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c77ad55f-1eeb-44ca-b392-c38177f71167 req-b0718ff2-1fe0-42f8-95ef-103e519fdbda service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c77ad55f-1eeb-44ca-b392-c38177f71167 req-b0718ff2-1fe0-42f8-95ef-103e519fdbda service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-c77ad55f-1eeb-44ca-b392-c38177f71167 req-b0718ff2-1fe0-42f8-95ef-103e519fdbda service nova] Creating event network-changed:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:31:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-c77ad55f-1eeb-44ca-b392-c38177f71167 req-b0718ff2-1fe0-42f8-95ef-103e519fdbda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061278 Apr 20 05:31:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 62/181] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:21 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-d7f674b4-66b8-495c-9a77-afe62b38c893 req-74c1c8fc-7046-4937-bcdf-004f7ca40919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d7f674b4-66b8-495c-9a77-afe62b38c893 req-74c1c8fc-7046-4937-bcdf-004f7ca40919 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d7f674b4-66b8-495c-9a77-afe62b38c893 req-74c1c8fc-7046-4937-bcdf-004f7ca40919 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d7f674b4-66b8-495c-9a77-afe62b38c893 req-74c1c8fc-7046-4937-bcdf-004f7ca40919 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-d7f674b4-66b8-495c-9a77-afe62b38c893 req-74c1c8fc-7046-4937-bcdf-004f7ca40919 service nova] Creating event network-changed:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:31:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-d7f674b4-66b8-495c-9a77-afe62b38c893 req-74c1c8fc-7046-4937-bcdf-004f7ca40919 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Apr 20 05:31:21 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 62/182] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:22 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-9160b172-4cee-4c19-92b2-d01da2c8022a req-6c637169-ea82-4a8a-bc14-bf8ed7442ba2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "name": "network-vif-plugged", "status": "completed", "tag": "d072d509-898e-4552-994c-060638df5951"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9160b172-4cee-4c19-92b2-d01da2c8022a req-6c637169-ea82-4a8a-bc14-bf8ed7442ba2 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9160b172-4cee-4c19-92b2-d01da2c8022a req-6c637169-ea82-4a8a-bc14-bf8ed7442ba2 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:22 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9160b172-4cee-4c19-92b2-d01da2c8022a req-6c637169-ea82-4a8a-bc14-bf8ed7442ba2 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:22 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-9160b172-4cee-4c19-92b2-d01da2c8022a req-6c637169-ea82-4a8a-bc14-bf8ed7442ba2 service nova] Creating event network-vif-plugged:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:31:22 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-9160b172-4cee-4c19-92b2-d01da2c8022a req-6c637169-ea82-4a8a-bc14-bf8ed7442ba2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048668 Apr 20 05:31:22 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 59/183] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:23 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-579ee0fa-9118-49cc-9497-d0fb411c167a req-a7d1933c-282b-4e48-886d-7fd285e4e912 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-plugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-579ee0fa-9118-49cc-9497-d0fb411c167a req-a7d1933c-282b-4e48-886d-7fd285e4e912 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-579ee0fa-9118-49cc-9497-d0fb411c167a req-a7d1933c-282b-4e48-886d-7fd285e4e912 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-579ee0fa-9118-49cc-9497-d0fb411c167a req-a7d1933c-282b-4e48-886d-7fd285e4e912 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-579ee0fa-9118-49cc-9497-d0fb411c167a req-a7d1933c-282b-4e48-886d-7fd285e4e912 service nova] Creating event network-vif-plugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:31:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-579ee0fa-9118-49cc-9497-d0fb411c167a req-a7d1933c-282b-4e48-886d-7fd285e4e912 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038203 Apr 20 05:31:23 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 63/184] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:24 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-466022a4-a081-45fe-8149-dc0b3456bbbf req-2f815fba-f501-416d-a402-e26a3fa7b0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "name": "network-vif-plugged", "status": "completed", "tag": "d072d509-898e-4552-994c-060638df5951"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-466022a4-a081-45fe-8149-dc0b3456bbbf req-2f815fba-f501-416d-a402-e26a3fa7b0e2 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-466022a4-a081-45fe-8149-dc0b3456bbbf req-2f815fba-f501-416d-a402-e26a3fa7b0e2 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:24 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-466022a4-a081-45fe-8149-dc0b3456bbbf req-2f815fba-f501-416d-a402-e26a3fa7b0e2 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-466022a4-a081-45fe-8149-dc0b3456bbbf req-2f815fba-f501-416d-a402-e26a3fa7b0e2 service nova] Creating event network-vif-plugged:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:31:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-466022a4-a081-45fe-8149-dc0b3456bbbf req-2f815fba-f501-416d-a402-e26a3fa7b0e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031053 Apr 20 05:31:24 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 63/185] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:25 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-f4203e89-4c3c-4cfe-9c91-fff2e29791eb req-4b54b3ad-b508-4960-8581-3be54b4cf258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-plugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:25 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f4203e89-4c3c-4cfe-9c91-fff2e29791eb req-4b54b3ad-b508-4960-8581-3be54b4cf258 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:25 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f4203e89-4c3c-4cfe-9c91-fff2e29791eb req-4b54b3ad-b508-4960-8581-3be54b4cf258 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:25 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f4203e89-4c3c-4cfe-9c91-fff2e29791eb req-4b54b3ad-b508-4960-8581-3be54b4cf258 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:25 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-f4203e89-4c3c-4cfe-9c91-fff2e29791eb req-4b54b3ad-b508-4960-8581-3be54b4cf258 service nova] Creating event network-vif-plugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:31:25 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-f4203e89-4c3c-4cfe-9c91-fff2e29791eb req-4b54b3ad-b508-4960-8581-3be54b4cf258 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029577 Apr 20 05:31:25 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 60/186] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-123778017", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "e0617596-5631-4c4b-8dd3-14d66bf18124"}]}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] validate_networks() for [('e0617596-5631-4c4b-8dd3-14d66bf18124', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for user 82ae116ab3d844afa141c1186f2f63d9 and project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:31:27 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:31:27 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-db4811bb-f094-4cfe-945f-b2f542a51c16 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.700869 Apr 20 05:31:27 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 64/187] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 05:31:27 2023] POST /compute/v2.1/servers => generated 378 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 05:31:27 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-4d23c2b8-3955-46df-9b9a-b87571c2b6c4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:27 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-4d23c2b8-3955-46df-9b9a-b87571c2b6c4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:27 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:27 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:28 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-4d23c2b8-3955-46df-9b9a-b87571c2b6c4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:28 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-4d23c2b8-3955-46df-9b9a-b87571c2b6c4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:28 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-4d23c2b8-3955-46df-9b9a-b87571c2b6c4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:31:28 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-4d23c2b8-3955-46df-9b9a-b87571c2b6c4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7" status: 200 len: 1394 microversion: 2.87 time: 0.099520 Apr 20 05:31:28 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 64/188] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:31:27 2023] GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 => generated 1394 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:31:30 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=12 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:30 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-bf38b198-47b5-4f54-a0f5-ef9de9d7d306 req-e0f28298-1193-415f-a96d-ef0d1499b11d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d6efa2a-a7ba-4d56-854b-8f1743acf8e7", "tag": "6b0fe944-c9d0-4879-b812-774d3926db47"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:30 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bf38b198-47b5-4f54-a0f5-ef9de9d7d306 req-e0f28298-1193-415f-a96d-ef0d1499b11d service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:30 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bf38b198-47b5-4f54-a0f5-ef9de9d7d306 req-e0f28298-1193-415f-a96d-ef0d1499b11d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:30 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bf38b198-47b5-4f54-a0f5-ef9de9d7d306 req-e0f28298-1193-415f-a96d-ef0d1499b11d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:30 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-bf38b198-47b5-4f54-a0f5-ef9de9d7d306 req-e0f28298-1193-415f-a96d-ef0d1499b11d service nova] Creating event network-changed:6b0fe944-c9d0-4879-b812-774d3926db47 for instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 on user Apr 20 05:31:30 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-bf38b198-47b5-4f54-a0f5-ef9de9d7d306 req-e0f28298-1193-415f-a96d-ef0d1499b11d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031367 Apr 20 05:31:30 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 61/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:31:32 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-6306a23e-4c98-442e-9cbf-41a0d5ffe0de req-d5ae79aa-e6b5-4616-9344-2f42547c59f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d6efa2a-a7ba-4d56-854b-8f1743acf8e7", "name": "network-vif-deleted", "tag": "6b0fe944-c9d0-4879-b812-774d3926db47"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:31:32 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6306a23e-4c98-442e-9cbf-41a0d5ffe0de req-d5ae79aa-e6b5-4616-9344-2f42547c59f9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:32 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6306a23e-4c98-442e-9cbf-41a0d5ffe0de req-d5ae79aa-e6b5-4616-9344-2f42547c59f9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:32 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6306a23e-4c98-442e-9cbf-41a0d5ffe0de req-d5ae79aa-e6b5-4616-9344-2f42547c59f9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:33 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.compute.server_external_events [req-6306a23e-4c98-442e-9cbf-41a0d5ffe0de req-d5ae79aa-e6b5-4616-9344-2f42547c59f9 service nova] Unable to find a host for instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7. Dropping event network-vif-deleted {{(pid=72597) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 05:31:33 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-6306a23e-4c98-442e-9cbf-41a0d5ffe0de req-d5ae79aa-e6b5-4616-9344-2f42547c59f9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.087219 Apr 20 05:31:33 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 65/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 90 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:42 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] HTTP exception thrown: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Request method failure captured: Apr 20 05:31:42 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d HTTP/1.1 Apr 20 05:31:42 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:31:42 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:31:42 user devstack@n-api.service[72596]: Connection: close Apr 20 05:31:42 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:31:42 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:31:42 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:31:42 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:31:42 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM19hiJNbUXGDnAqe_OZZEvl5CROJvlLokCS5QGTqvmspXtnKhBwqxuOG30-qDkk-LgPJOXKN8xC1h_MaluZ4YpDb6mzacGr1FL8jl_zhBwS6WZSdNu9maeCn0_vmSEv-HY2R6HH8crjH_SpIHjCxiR3ZNezxWz5dbiBZEsDpW8HqRc Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Project-Id: 3acb217a867f47aab97360ef5dd2e98c Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Tenant-Id: 3acb217a867f47aab97360ef5dd2e98c Apr 20 05:31:42 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:42 user devstack@n-api.service[72596]: X-User: tempest-AttachSCSIVolumeTestJSON-1056669663-project-member Apr 20 05:31:42 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:31:42 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:31:42 user devstack@n-api.service[72596]: X-User-Id: 8afc1850f3ae430f92db6158f202fd21 Apr 20 05:31:42 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1056669663-project-member Apr 20 05:31:42 user devstack@n-api.service[72596]: method: > Apr 20 05:31:42 user devstack@n-api.service[72596]: exception: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:42 user devstack@n-api.service[72596]: action_args: {'id': '1b9dfc9e-e473-46cb-9963-2ba47fcfad5d'} Apr 20 05:31:42 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:42 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:42 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Returning 404 to user: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:42 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-0cf65fc1-a82d-463a-a885-93af856a6eea tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 404 len: 111 microversion: 2.1 time: 0.035867 Apr 20 05:31:42 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 65/191] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:42 2023] GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:42 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:42 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=28 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:42 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-206c4494-60fb-45a0-bbf2-f7d64c4814e5 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '.version_select at 0x7ff3029a71c0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:42 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-206c4494-60fb-45a0-bbf2-f7d64c4814e5 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504348446" status: 202 len: 0 microversion: 2.1 time: 0.026239 Apr 20 05:31:42 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 62/192] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 05:31:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504348446 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:43 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] HTTP exception thrown: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Request method failure captured: Apr 20 05:31:43 user devstack@n-api.service[72597]: request: DELETE /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d HTTP/1.1 Apr 20 05:31:43 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:31:43 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:31:43 user devstack@n-api.service[72597]: Connection: close Apr 20 05:31:43 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:31:43 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:31:43 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:31:43 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:31:43 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM19hiJNbUXGDnAqe_OZZEvl5CROJvlLokCS5QGTqvmspXtnKhBwqxuOG30-qDkk-LgPJOXKN8xC1h_MaluZ4YpDb6mzacGr1FL8jl_zhBwS6WZSdNu9maeCn0_vmSEv-HY2R6HH8crjH_SpIHjCxiR3ZNezxWz5dbiBZEsDpW8HqRc Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Project-Id: 3acb217a867f47aab97360ef5dd2e98c Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Tenant-Id: 3acb217a867f47aab97360ef5dd2e98c Apr 20 05:31:43 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:43 user devstack@n-api.service[72597]: X-User: tempest-AttachSCSIVolumeTestJSON-1056669663-project-member Apr 20 05:31:43 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:31:43 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:31:43 user devstack@n-api.service[72597]: X-User-Id: 8afc1850f3ae430f92db6158f202fd21 Apr 20 05:31:43 user devstack@n-api.service[72597]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1056669663-project-member Apr 20 05:31:43 user devstack@n-api.service[72597]: method: > Apr 20 05:31:43 user devstack@n-api.service[72597]: exception: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72597]: action_args: {'id': '1b9dfc9e-e473-46cb-9963-2ba47fcfad5d'} Apr 20 05:31:43 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Returning 404 to user: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:43 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7bd32fbe-0ca2-4868-a9df-5f1047cfdcc4 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 404 len: 111 microversion: 2.1 time: 0.061934 Apr 20 05:31:43 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:31:43 2023] DELETE /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] [instance: 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:43 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] HTTP exception thrown: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Request method failure captured: Apr 20 05:31:43 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d HTTP/1.1 Apr 20 05:31:43 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:31:43 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:31:43 user devstack@n-api.service[72596]: Connection: close Apr 20 05:31:43 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:31:43 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:31:43 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:31:43 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:31:43 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM19hiJNbUXGDnAqe_OZZEvl5CROJvlLokCS5QGTqvmspXtnKhBwqxuOG30-qDkk-LgPJOXKN8xC1h_MaluZ4YpDb6mzacGr1FL8jl_zhBwS6WZSdNu9maeCn0_vmSEv-HY2R6HH8crjH_SpIHjCxiR3ZNezxWz5dbiBZEsDpW8HqRc Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Project-Id: 3acb217a867f47aab97360ef5dd2e98c Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3acb217a867f47aab97360ef5dd2e98c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Tenant-Id: 3acb217a867f47aab97360ef5dd2e98c Apr 20 05:31:43 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1056669663 Apr 20 05:31:43 user devstack@n-api.service[72596]: X-User: tempest-AttachSCSIVolumeTestJSON-1056669663-project-member Apr 20 05:31:43 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:31:43 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:31:43 user devstack@n-api.service[72596]: X-User-Id: 8afc1850f3ae430f92db6158f202fd21 Apr 20 05:31:43 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1056669663-project-member Apr 20 05:31:43 user devstack@n-api.service[72596]: method: > Apr 20 05:31:43 user devstack@n-api.service[72596]: exception: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72596]: action_args: {'id': '1b9dfc9e-e473-46cb-9963-2ba47fcfad5d'} Apr 20 05:31:43 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. Apr 20 05:31:43 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:43 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] Returning 404 to user: Instance 1b9dfc9e-e473-46cb-9963-2ba47fcfad5d could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:43 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-c36b895e-f845-4999-811c-8968b51047e3 tempest-AttachSCSIVolumeTestJSON-1056669663 tempest-AttachSCSIVolumeTestJSON-1056669663-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d" status: 404 len: 111 microversion: 2.1 time: 0.027214 Apr 20 05:31:43 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 66/194] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:43 2023] GET /compute/v2.1/servers/1b9dfc9e-e473-46cb-9963-2ba47fcfad5d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] [instance: 83afcd8b-7577-4632-bc26-8ee4fbadeb6e] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] HTTP exception thrown: Instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e could not be found. Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Request method failure captured: Apr 20 05:31:59 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e HTTP/1.1 Apr 20 05:31:59 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:31:59 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:31:59 user devstack@n-api.service[72598]: Connection: close Apr 20 05:31:59 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:31:59 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:31:59 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:31:59 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:31:59 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM2fkHf6-6OcZyjPL3V__DC6g5w6i5QNjxCKITs5o9tO5Q9mf6pz6aPJ5_Cu5B4W5WzAvm23iSSeNluiCKr-RiiBmTqkXCfACyIs1J9VoIpb3r_Pgl6FMbbmaox6Krdz0_iddzVMmgZO1smaeYdSVuD37WR2JgpQPWtsK8L5xv9dj1Y Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Project-Id: 3d5cf3b44333417e9221dde77ba4becb Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1857784873 Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d5cf3b44333417e9221dde77ba4becb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d5cf3b44333417e9221dde77ba4becb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d5cf3b44333417e9221dde77ba4becb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Tenant: tempest-SnapshotDataIntegrityTests-1857784873 Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Tenant-Id: 3d5cf3b44333417e9221dde77ba4becb Apr 20 05:31:59 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1857784873 Apr 20 05:31:59 user devstack@n-api.service[72598]: X-User: tempest-SnapshotDataIntegrityTests-1857784873-project-member Apr 20 05:31:59 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:31:59 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:31:59 user devstack@n-api.service[72598]: X-User-Id: 25a086c1dde540b194c70100b4ea61d9 Apr 20 05:31:59 user devstack@n-api.service[72598]: X-User-Name: tempest-SnapshotDataIntegrityTests-1857784873-project-member Apr 20 05:31:59 user devstack@n-api.service[72598]: method: > Apr 20 05:31:59 user devstack@n-api.service[72598]: exception: Instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e could not be found. Apr 20 05:31:59 user devstack@n-api.service[72598]: action_args: {'id': '83afcd8b-7577-4632-bc26-8ee4fbadeb6e'} Apr 20 05:31:59 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e could not be found. Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e could not be found. Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e could not be found. Apr 20 05:31:59 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Returning 404 to user: Instance 83afcd8b-7577-4632-bc26-8ee4fbadeb6e could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-14a24548-62d6-43f0-99e2-e243334699a0 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e" status: 404 len: 111 microversion: 2.1 time: 0.035829 Apr 20 05:31:59 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 63/195] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:31:59 2023] GET /compute/v2.1/servers/83afcd8b-7577-4632-bc26-8ee4fbadeb6e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:31:59 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-8472196a-5d56-4b9a-a188-4189b75d8823 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] Calling method '.version_select at 0x7ff3029cd090>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:59 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:59 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:59 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-8472196a-5d56-4b9a-a188-4189b75d8823 tempest-SnapshotDataIntegrityTests-1857784873 tempest-SnapshotDataIntegrityTests-1857784873-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1419304051" status: 202 len: 0 microversion: 2.1 time: 0.030802 Apr 20 05:31:59 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 20 05:31:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1419304051 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:31:59 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] HTTP exception thrown: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Request method failure captured: Apr 20 05:31:59 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a HTTP/1.1 Apr 20 05:31:59 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:31:59 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:31:59 user devstack@n-api.service[72596]: Connection: close Apr 20 05:31:59 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:31:59 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:31:59 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:31:59 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:31:59 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM2p1JEq61Mr_-iHTrn1UL4kG1V5eQj3EaelS9qGo-1LnsZFnPDq_Ll3X6i2VSy6dGPk4OxQt184_xkIrc-UDrOHCSnRcdCWwjSIhyU2DTLFaKVH_7Co8vnYkg1MNxEcjH8XPTMtSaukOTBlvKpNuhFykE9ojaNROtutG4mkY5H8MC0 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Project-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Tenant-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:31:59 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:31:59 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:31:59 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:31:59 user devstack@n-api.service[72596]: X-User-Id: 4ef040bbdf0346b98a7816a6d0b02cdf Apr 20 05:31:59 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:31:59 user devstack@n-api.service[72596]: method: > Apr 20 05:31:59 user devstack@n-api.service[72596]: exception: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:31:59 user devstack@n-api.service[72596]: action_args: {'id': '5840d3e8-bf88-40d9-a864-03fb8c090e1a'} Apr 20 05:31:59 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:31:59 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:31:59 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Returning 404 to user: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:31:59 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-21cfdc9d-3d22-4190-b154-e410ac490561 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 404 len: 111 microversion: 2.20 time: 0.043575 Apr 20 05:31:59 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 67/197] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:31:59 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:31:59 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d071fd95-7a56-4a23-a182-6950b13ea159 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '.version_select at 0x7ff302b62b00>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:31:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d071fd95-7a56-4a23-a182-6950b13ea159 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-546899264" status: 204 len: 0 microversion: 2.20 time: 0.024615 Apr 20 05:31:59 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 64/198] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 20 05:31:59 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-546899264 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:32:00 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-06391d77-1c37-4f39-bda2-036026080fe9 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Action: 'create', calling method: .version_select at 0x7ff3029ccca0>, body: {"keypair": {"name": "tempest-keypair-1467630871", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2HrHlKuOhJ62Xx3j6nYtJm8nbet/H2IAPT/MnbgJY8xLah4vWVMmxXoNQ50mxrvB8RlY0xBNmOZT581fAWOgMAX8nHWE4Yw2Tn+uv9hCBGTKsMhSvj+SyC2OHeV31atQ=="}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:00 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-06391d77-1c37-4f39-bda2-036026080fe9 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for project 25e3d8c4aae04740b98c807df5434a53. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:32:00 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-06391d77-1c37-4f39-bda2-036026080fe9 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for user 4ef040bbdf0346b98a7816a6d0b02cdf and project 25e3d8c4aae04740b98c807df5434a53. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:32:00 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-06391d77-1c37-4f39-bda2-036026080fe9 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.062862 Apr 20 05:32:00 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 68/199] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 05:32:00 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 65 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 05:32:02 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1769239101", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "0ce9eb4b-2eb8-4368-9d6e-d2cab7b007b0"}], "security_groups": [{"name": "tempest-securitygroup--1845978237"}], "key_name": "tempest-keypair-1467630871", "user_data": "}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:02 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] validate_networks() for [('0ce9eb4b-2eb8-4368-9d6e-d2cab7b007b0', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for project 25e3d8c4aae04740b98c807df5434a53. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Getting quotas for user 4ef040bbdf0346b98a7816a6d0b02cdf and project 25e3d8c4aae04740b98c807df5434a53. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:32:03 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:32:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-6fa0e1ac-6136-4833-ac47-1cb8805330b6 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.755418 Apr 20 05:32:03 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 68/200] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 05:32:02 2023] POST /compute/v2.1/servers => generated 400 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 05:32:03 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-2c8d33d5-b7d9-46dd-8d2c-b7352db9992e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:03 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-2c8d33d5-b7d9-46dd-8d2c-b7352db9992e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:03 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d2e01e51-8364-43c5-a9de-f0f44469f416 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 200 len: 1489 microversion: 2.1 time: 0.391268 Apr 20 05:32:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 65/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:03 2023] GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 1489 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:32:03 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-2c8d33d5-b7d9-46dd-8d2c-b7352db9992e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:03 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-2c8d33d5-b7d9-46dd-8d2c-b7352db9992e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:03 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-2c8d33d5-b7d9-46dd-8d2c-b7352db9992e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:03 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-2c8d33d5-b7d9-46dd-8d2c-b7352db9992e tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 200 len: 1276 microversion: 2.20 time: 0.417993 Apr 20 05:32:03 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 69/202] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:32:03 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 1276 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:32:04 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-2810275a-ccb9-4306-8f2d-f3462a04ebe4 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Action: 'create', calling method: .version_select at 0x7ff302912a70>, body: {"keypair": {"name": "tempest-keypair-1214828661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP5WnsPSG69s1Ah0GxvA7qz2KN0TS7psfd2D1egvKB/IyYJC1uVjkeZo2qq80EosS0+lFfJOn+qjHAF6dCnZULJpT6CJwx23eU1FEfBKkKuO5boc9Ao8NcB38/r3XoIk8w=="}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:04 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-2810275a-ccb9-4306-8f2d-f3462a04ebe4 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Getting quotas for project 43425b2c00284dc48e18d06e1a8e21e5. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:32:04 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-2810275a-ccb9-4306-8f2d-f3462a04ebe4 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Getting quotas for user 4eb937659897494cb185f8f5ce7f8b22 and project 43425b2c00284dc48e18d06e1a8e21e5. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:32:04 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-2810275a-ccb9-4306-8f2d-f3462a04ebe4 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.321397 Apr 20 05:32:04 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 69/203] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:32:04 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:06 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-759715989", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "31e06cfe-2345-4195-95ac-8e8981df4a22"}], "security_groups": [{"name": "tempest-securitygroup--294295577"}], "key_name": "tempest-keypair-1214828661", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:06 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] validate_networks() for [('31e06cfe-2345-4195-95ac-8e8981df4a22', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:32:06 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-248fc2cf-ef7f-49ef-b9b6-5c9f41da805c req-2b094a1d-e1ea-4c5a-ad63-955129b52b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-248fc2cf-ef7f-49ef-b9b6-5c9f41da805c req-2b094a1d-e1ea-4c5a-ad63-955129b52b72 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-248fc2cf-ef7f-49ef-b9b6-5c9f41da805c req-2b094a1d-e1ea-4c5a-ad63-955129b52b72 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-248fc2cf-ef7f-49ef-b9b6-5c9f41da805c req-2b094a1d-e1ea-4c5a-ad63-955129b52b72 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-248fc2cf-ef7f-49ef-b9b6-5c9f41da805c req-2b094a1d-e1ea-4c5a-ad63-955129b52b72 service nova] Creating event network-changed:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:32:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-248fc2cf-ef7f-49ef-b9b6-5c9f41da805c req-2b094a1d-e1ea-4c5a-ad63-955129b52b72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038160 Apr 20 05:32:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 70/204] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Getting quotas for project 43425b2c00284dc48e18d06e1a8e21e5. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Getting quotas for user 4eb937659897494cb185f8f5ce7f8b22 and project 43425b2c00284dc48e18d06e1a8e21e5. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:32:07 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:32:07 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:07 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-75839dd2-2f70-47e4-97c0-dfe23d6f30c5 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 200 len: 1545 microversion: 2.1 time: 0.363443 Apr 20 05:32:07 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 70/205] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:07 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 1545 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:32:07 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-a040ad1f-2da0-4ebb-8986-25627b3a79af tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.792859 Apr 20 05:32:07 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 66/206] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:32:06 2023] POST /compute/v2.1/servers => generated 403 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:32:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c2a16f89-e64e-458e-9911-36ece2287d1d tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:07 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-c2a16f89-e64e-458e-9911-36ece2287d1d tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:07 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-c2a16f89-e64e-458e-9911-36ece2287d1d tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb937659897494cb185f8f5ce7f8b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43425b2c00284dc48e18d06e1a8e21e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-c2a16f89-e64e-458e-9911-36ece2287d1d tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf" status: 200 len: 1235 microversion: 2.1 time: 0.300620 Apr 20 05:32:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 71/207] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:07 2023] GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf => generated 1235 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:08 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1071a61ffe56426997058ad6c6a2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6404b98cd405456f8d4c275b72ef3d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:08 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-d5231736-655b-48c8-9426-3dd73beae854 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 200 len: 1537 microversion: 2.1 time: 0.325604 Apr 20 05:32:08 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 71/208] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:08 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 1537 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:32:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-8cf9a930-3307-4f3b-8796-3fdb9b9b1a76 req-9106728e-1ea6-4e9a-aeaa-ba259133ccab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "name": "network-vif-plugged", "status": "completed", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8cf9a930-3307-4f3b-8796-3fdb9b9b1a76 req-9106728e-1ea6-4e9a-aeaa-ba259133ccab service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8cf9a930-3307-4f3b-8796-3fdb9b9b1a76 req-9106728e-1ea6-4e9a-aeaa-ba259133ccab service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-8cf9a930-3307-4f3b-8796-3fdb9b9b1a76 req-9106728e-1ea6-4e9a-aeaa-ba259133ccab service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-8cf9a930-3307-4f3b-8796-3fdb9b9b1a76 req-9106728e-1ea6-4e9a-aeaa-ba259133ccab service nova] Creating event network-vif-plugged:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:32:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-8cf9a930-3307-4f3b-8796-3fdb9b9b1a76 req-9106728e-1ea6-4e9a-aeaa-ba259133ccab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031540 Apr 20 05:32:09 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 67/209] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:10 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:32:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-02f64599-721c-4a8c-8f03-74b3a551939f req-8df3b354-ed2d-4941-a3c9-fe2220fb07b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-02f64599-721c-4a8c-8f03-74b3a551939f req-8df3b354-ed2d-4941-a3c9-fe2220fb07b6 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-02f64599-721c-4a8c-8f03-74b3a551939f req-8df3b354-ed2d-4941-a3c9-fe2220fb07b6 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-02f64599-721c-4a8c-8f03-74b3a551939f req-8df3b354-ed2d-4941-a3c9-fe2220fb07b6 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-02f64599-721c-4a8c-8f03-74b3a551939f req-8df3b354-ed2d-4941-a3c9-fe2220fb07b6 service nova] Creating event network-changed:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:32:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-02f64599-721c-4a8c-8f03-74b3a551939f req-8df3b354-ed2d-4941-a3c9-fe2220fb07b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047931 Apr 20 05:32:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 72/210] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:10 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-73bf910b-2de7-409a-b5b1-e660e91a4f85 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 204 len: 0 microversion: 2.1 time: 0.147196 Apr 20 05:32:10 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 72/211] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:32:10 2023] DELETE /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:10 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-db126c34-d370-4e8a-b139-fd27b4068f47 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 200 len: 1500 microversion: 2.1 time: 0.264556 Apr 20 05:32:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 68/212] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:10 2023] GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 1500 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:32:11 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-d2f762f9-f018-4549-a7d7-b8853562a3b1 req-843645e4-94eb-40e6-abf1-6ef21325177c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "name": "network-vif-plugged", "status": "completed", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d2f762f9-f018-4549-a7d7-b8853562a3b1 req-843645e4-94eb-40e6-abf1-6ef21325177c service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d2f762f9-f018-4549-a7d7-b8853562a3b1 req-843645e4-94eb-40e6-abf1-6ef21325177c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d2f762f9-f018-4549-a7d7-b8853562a3b1 req-843645e4-94eb-40e6-abf1-6ef21325177c service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-d2f762f9-f018-4549-a7d7-b8853562a3b1 req-843645e4-94eb-40e6-abf1-6ef21325177c service nova] Creating event network-vif-plugged:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:32:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-d2f762f9-f018-4549-a7d7-b8853562a3b1 req-843645e4-94eb-40e6-abf1-6ef21325177c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037838 Apr 20 05:32:11 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 73/213] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:12 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-c6b241e9-317b-42d6-a386-4807770689d0 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.238975 Apr 20 05:32:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 73/214] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:11 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:32:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-223badac-15b7-4f0d-9d9a-7cf65c839e9a req-a87188d8-c6b4-4d82-b5a7-86f0f3eb19a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0156a5dd-1667-414e-bbaa-1980596b82e5", "name": "network-vif-deleted", "tag": "fc5ee828-7d3b-404c-8847-dc95a54cea2e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-223badac-15b7-4f0d-9d9a-7cf65c839e9a req-a87188d8-c6b4-4d82-b5a7-86f0f3eb19a9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-223badac-15b7-4f0d-9d9a-7cf65c839e9a req-a87188d8-c6b4-4d82-b5a7-86f0f3eb19a9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-223badac-15b7-4f0d-9d9a-7cf65c839e9a req-a87188d8-c6b4-4d82-b5a7-86f0f3eb19a9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-223badac-15b7-4f0d-9d9a-7cf65c839e9a req-a87188d8-c6b4-4d82-b5a7-86f0f3eb19a9 service nova] Creating event network-vif-deleted:fc5ee828-7d3b-404c-8847-dc95a54cea2e for instance 0156a5dd-1667-414e-bbaa-1980596b82e5 on user Apr 20 05:32:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-223badac-15b7-4f0d-9d9a-7cf65c839e9a req-a87188d8-c6b4-4d82-b5a7-86f0f3eb19a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031721 Apr 20 05:32:12 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 69/215] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0156a5dd-1667-414e-bbaa-1980596b82e5", "name": "network-vif-unplugged", "status": "completed", "tag": "fc5ee828-7d3b-404c-8847-dc95a54cea2e"}, {"server_uuid": "0156a5dd-1667-414e-bbaa-1980596b82e5", "name": "network-vif-plugged", "status": "completed", "tag": "fc5ee828-7d3b-404c-8847-dc95a54cea2e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] Creating event network-vif-unplugged:fc5ee828-7d3b-404c-8847-dc95a54cea2e for instance 0156a5dd-1667-414e-bbaa-1980596b82e5 on user Apr 20 05:32:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] Creating event network-vif-plugged:fc5ee828-7d3b-404c-8847-dc95a54cea2e for instance 0156a5dd-1667-414e-bbaa-1980596b82e5 on user Apr 20 05:32:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-40b2023b-68a6-4397-9ccc-a74681e13ad4 req-65bfefcb-fc39-421c-b3a6-68c70ebe5b5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.072249 Apr 20 05:32:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 74/216] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:13 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "name": "network-vif-plugged", "status": "completed", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}, {"server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "name": "network-vif-plugged", "status": "completed", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:13 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:13 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:13 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:13 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] Creating event network-vif-plugged:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:32:13 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] Creating event network-vif-plugged:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:32:13 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-9e144618-7ca0-4fe7-9337-f6c2256c8f09 req-27872b70-5875-4044-9e12-ad41eade06d9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032789 Apr 20 05:32:13 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 74/217] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:13 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG nova.objects.instance [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lazy-loading 'fault' on Instance uuid 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 {{(pid=72598) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:18 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:18 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-b386c80e-105d-440e-96f5-1572f30064e4 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7" status: 200 len: 1649 microversion: 2.87 time: 0.259895 Apr 20 05:32:18 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 70/218] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:32:18 2023] GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 => generated 1649 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=10 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Doing local delete in cell ae6ab1ab-1140-4b4c-bf55-c15161615bab(cell1) {{(pid=72596) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:18 user devstack@n-api.service[72596]: WARNING nova.compute.api [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] instance's host None is down, deleting from database Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] deallocate_for_instance() {{(pid=72596) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Instance cache missing network info. {{(pid=72596) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Updating instance_info_cache with network_info: [] {{(pid=72596) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 05:32:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=72596) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 05:32:18 user devstack@n-api.service[72596]: WARNING nova.compute.api [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 05:32:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-c7c40fdc-e7eb-46a4-8b52-16a0ec255a4c tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7" status: 204 len: 0 microversion: 2.87 time: 0.615345 Apr 20 05:32:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 75/219] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:32:18 2023] DELETE /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=8 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] HTTP exception thrown: Instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 could not be found. Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Request method failure captured: Apr 20 05:32:19 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 HTTP/1.1 Apr 20 05:32:19 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:32:19 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:32:19 user devstack@n-api.service[72597]: Connection: close Apr 20 05:32:19 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:32:19 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:32:19 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:32:19 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:32:19 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM165r8zqHmCsou-O3eC_SwFetKJgys3yS1vQYllHFUXXnq9-EgvLvGsJcBGYTecRpSUKpPFpGdASpgUr4a-KiCWYUHe84gKGFMc0idZCUgfZMdRLlQ_hyYS3Mq1STskHbDHrSvBQZNzKToOoS2iTAq87t39n5RGtQmfth8nF-5eKM0 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Project-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29f76ebb01544478b555aff667debbd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Tenant-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:32:19 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:32:19 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:32:19 user devstack@n-api.service[72597]: X-User-Id: 82ae116ab3d844afa141c1186f2f63d9 Apr 20 05:32:19 user devstack@n-api.service[72597]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:32:19 user devstack@n-api.service[72597]: method: > Apr 20 05:32:19 user devstack@n-api.service[72597]: exception: Instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 could not be found. Apr 20 05:32:19 user devstack@n-api.service[72597]: action_args: {'id': '6d6efa2a-a7ba-4d56-854b-8f1743acf8e7'} Apr 20 05:32:19 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 could not be found. Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 could not be found. Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 could not be found. Apr 20 05:32:19 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:32:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Returning 404 to user: Instance 6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:32:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-f7507d0d-6de6-4619-8480-a8206579b5db tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7" status: 404 len: 111 microversion: 2.87 time: 0.037329 Apr 20 05:32:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 75/220] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:32:19 2023] GET /compute/v2.1/servers/6d6efa2a-a7ba-4d56-854b-8f1743acf8e7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-289909219", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "e0617596-5631-4c4b-8dd3-14d66bf18124"}]}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] validate_networks() for [('e0617596-5631-4c4b-8dd3-14d66bf18124', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for user 82ae116ab3d844afa141c1186f2f63d9 and project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:32:19 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:32:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-45b41373-6d01-4626-aa33-517e7792e6e0 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.572262 Apr 20 05:32:19 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 71/221] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 05:32:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 05:32:19 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-9ab7d995-caa2-461d-9ff5-f34b4ad54f78 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:19 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-9ab7d995-caa2-461d-9ff5-f34b4ad54f78 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:19 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-9ab7d995-caa2-461d-9ff5-f34b4ad54f78 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:19 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-9ab7d995-caa2-461d-9ff5-f34b4ad54f78 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:19 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-9ab7d995-caa2-461d-9ff5-f34b4ad54f78 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-9ab7d995-caa2-461d-9ff5-f34b4ad54f78 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084" status: 200 len: 1394 microversion: 2.87 time: 0.074690 Apr 20 05:32:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 76/222] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:32:19 2023] GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 => generated 1394 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:32:22 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-dc723aa1-d96e-4fda-b8fa-1c21700cecd8 req-9f8ffded-7514-472d-a237-4ec1a20c8392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47aac33d-2148-4155-b25f-4eeef975c084", "tag": "b5a45572-7f39-418e-9dd3-2231042b048e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:22 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-dc723aa1-d96e-4fda-b8fa-1c21700cecd8 req-9f8ffded-7514-472d-a237-4ec1a20c8392 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:22 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-dc723aa1-d96e-4fda-b8fa-1c21700cecd8 req-9f8ffded-7514-472d-a237-4ec1a20c8392 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:22 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-dc723aa1-d96e-4fda-b8fa-1c21700cecd8 req-9f8ffded-7514-472d-a237-4ec1a20c8392 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:22 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-dc723aa1-d96e-4fda-b8fa-1c21700cecd8 req-9f8ffded-7514-472d-a237-4ec1a20c8392 service nova] Creating event network-changed:b5a45572-7f39-418e-9dd3-2231042b048e for instance 47aac33d-2148-4155-b25f-4eeef975c084 on user Apr 20 05:32:22 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-dc723aa1-d96e-4fda-b8fa-1c21700cecd8 req-9f8ffded-7514-472d-a237-4ec1a20c8392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037737 Apr 20 05:32:22 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 76/223] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:24 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-f9ecdaef-1d39-428b-a581-5a6d3817945b req-3c458d69-d892-41ba-8c3e-b9540a3dc910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aac33d-2148-4155-b25f-4eeef975c084", "name": "network-vif-plugged", "status": "completed", "tag": "b5a45572-7f39-418e-9dd3-2231042b048e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f9ecdaef-1d39-428b-a581-5a6d3817945b req-3c458d69-d892-41ba-8c3e-b9540a3dc910 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f9ecdaef-1d39-428b-a581-5a6d3817945b req-3c458d69-d892-41ba-8c3e-b9540a3dc910 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f9ecdaef-1d39-428b-a581-5a6d3817945b req-3c458d69-d892-41ba-8c3e-b9540a3dc910 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-f9ecdaef-1d39-428b-a581-5a6d3817945b req-3c458d69-d892-41ba-8c3e-b9540a3dc910 service nova] Creating event network-vif-plugged:b5a45572-7f39-418e-9dd3-2231042b048e for instance 47aac33d-2148-4155-b25f-4eeef975c084 on user Apr 20 05:32:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-f9ecdaef-1d39-428b-a581-5a6d3817945b req-3c458d69-d892-41ba-8c3e-b9540a3dc910 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032894 Apr 20 05:32:24 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 72/224] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:26 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-50e485b4-6aba-4b6b-9830-f8a507eeb404 req-b0b951b4-ddf8-43c3-9bf4-3254538c25af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aac33d-2148-4155-b25f-4eeef975c084", "name": "network-vif-plugged", "status": "completed", "tag": "b5a45572-7f39-418e-9dd3-2231042b048e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:32:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-50e485b4-6aba-4b6b-9830-f8a507eeb404 req-b0b951b4-ddf8-43c3-9bf4-3254538c25af service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-50e485b4-6aba-4b6b-9830-f8a507eeb404 req-b0b951b4-ddf8-43c3-9bf4-3254538c25af service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:26 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-50e485b4-6aba-4b6b-9830-f8a507eeb404 req-b0b951b4-ddf8-43c3-9bf4-3254538c25af service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-50e485b4-6aba-4b6b-9830-f8a507eeb404 req-b0b951b4-ddf8-43c3-9bf4-3254538c25af service nova] Creating event network-vif-plugged:b5a45572-7f39-418e-9dd3-2231042b048e for instance 47aac33d-2148-4155-b25f-4eeef975c084 on user Apr 20 05:32:26 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-50e485b4-6aba-4b6b-9830-f8a507eeb404 req-b0b951b4-ddf8-43c3-9bf4-3254538c25af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040509 Apr 20 05:32:26 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 77/225] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:32:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:53 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:54 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:54 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:54 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:54 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-b2d6c400-39cf-451f-8939-911d23880cd7 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 200 len: 1587 microversion: 2.20 time: 0.261178 Apr 20 05:32:54 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 77/226] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:32:53 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 1587 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=32 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:32:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:32:58 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb937659897494cb185f8f5ce7f8b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43425b2c00284dc48e18d06e1a8e21e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:32:58 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-6aaeb306-688a-4bfb-8cb6-08767aaced8b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf" status: 200 len: 1544 microversion: 2.1 time: 0.241345 Apr 20 05:32:58 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 73/227] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:32:57 2023] GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf => generated 1544 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] HTTP exception thrown: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Request method failure captured: Apr 20 05:33:00 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 HTTP/1.1 Apr 20 05:33:00 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:33:00 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:33:00 user devstack@n-api.service[72596]: Connection: close Apr 20 05:33:00 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:33:00 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:33:00 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:33:00 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:33:00 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM15L4z_Hah_uMb7Zq2aXeiR27dykOqtPffUAmGsLN-dJUgnyoc7J2CAqW9omj3tM46RzvwUtanaN_KVky7MxxrkbfVMHc-O1qBKTDfr_UBgU_IFmfFqnapJi3hB5qRCflJJ5v7CBbI3PDVDfyyO_WjfGdYorDurh2Rzeax6oOvVp_M Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Project-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Project-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Tenant: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Tenant-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-User: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:33:00 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:33:00 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:33:00 user devstack@n-api.service[72596]: X-User-Id: 198edaee95b0445b8cb018046d790576 Apr 20 05:33:00 user devstack@n-api.service[72596]: X-User-Name: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:33:00 user devstack@n-api.service[72596]: method: > Apr 20 05:33:00 user devstack@n-api.service[72596]: exception: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:33:00 user devstack@n-api.service[72596]: action_args: {'id': '0156a5dd-1667-414e-bbaa-1980596b82e5'} Apr 20 05:33:00 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:33:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:33:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Returning 404 to user: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:33:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-dafdc915-ed22-4c73-bf8c-5d742e98b94a tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 404 len: 111 microversion: 2.1 time: 0.047599 Apr 20 05:33:00 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 78/228] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:00 2023] GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:01 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:01 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a3bfb3be-acaa-4cbe-ac2a-4c5f2c8521c5 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1493 microversion: 2.1 time: 0.237766 Apr 20 05:33:01 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 78/229] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:00 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1493 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:03 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-799d3109-8a53-4b1c-84ee-e1f26c99408c tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266" status: 200 len: 1502 microversion: 2.1 time: 0.227029 Apr 20 05:33:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 74/230] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:03 2023] GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:07 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:07 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-dbaab278-a0fa-41b2-b6ae-07c7ba4210bc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.185044 Apr 20 05:33:07 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:33:07 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089/os-interface => generated 282 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-c5fb1858-e79c-411f-9036-cf6667ab203a req-f5665ae7-370f-4251-a102-6f9dc0599e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "tag": "d072d509-898e-4552-994c-060638df5951"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c5fb1858-e79c-411f-9036-cf6667ab203a req-f5665ae7-370f-4251-a102-6f9dc0599e99 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c5fb1858-e79c-411f-9036-cf6667ab203a req-f5665ae7-370f-4251-a102-6f9dc0599e99 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:08 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c5fb1858-e79c-411f-9036-cf6667ab203a req-f5665ae7-370f-4251-a102-6f9dc0599e99 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:08 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-c5fb1858-e79c-411f-9036-cf6667ab203a req-f5665ae7-370f-4251-a102-6f9dc0599e99 service nova] Creating event network-changed:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:33:08 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-c5fb1858-e79c-411f-9036-cf6667ab203a req-f5665ae7-370f-4251-a102-6f9dc0599e99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033067 Apr 20 05:33:08 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 79/232] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:08 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-a142ba58-e318-4a21-bfc1-403a5dad6f36 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089/ips" status: 200 len: 108 microversion: 2.1 time: 0.036689 Apr 20 05:33:08 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 80/233] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:33:08 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:08 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-fc607d02-f51b-4c0d-b9c3-6ea2580e5b19 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.219991 Apr 20 05:33:08 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 75/234] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:33:08 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8/os-interface => generated 283 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-18568336-b412-4adc-b324-044994838bcf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8/ips" status: 200 len: 105 microversion: 2.1 time: 0.038695 Apr 20 05:33:09 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 80/235] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:33:09 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8/ips => generated 105 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:10 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:33:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-8a92f6ce-3b80-401a-92d5-cc654ffcafa0 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 204 len: 0 microversion: 2.1 time: 0.161026 Apr 20 05:33:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 76/236] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:33:09 2023] DELETE /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-7680d7d9-7da0-4097-920a-5c409e47de53 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084" status: 200 len: 1689 microversion: 2.87 time: 0.305831 Apr 20 05:33:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 81/237] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:33:09 2023] GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 => generated 1689 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:33:10 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-83cb6cc9-9ed0-402e-9281-e96cf2ea1706 req-395fc940-9d7f-47ed-af66-98375366e279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "name": "network-vif-unplugged", "status": "completed", "tag": "d072d509-898e-4552-994c-060638df5951"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-83cb6cc9-9ed0-402e-9281-e96cf2ea1706 req-395fc940-9d7f-47ed-af66-98375366e279 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-83cb6cc9-9ed0-402e-9281-e96cf2ea1706 req-395fc940-9d7f-47ed-af66-98375366e279 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-83cb6cc9-9ed0-402e-9281-e96cf2ea1706 req-395fc940-9d7f-47ed-af66-98375366e279 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-83cb6cc9-9ed0-402e-9281-e96cf2ea1706 req-395fc940-9d7f-47ed-af66-98375366e279 service nova] Creating event network-vif-unplugged:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:33:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-83cb6cc9-9ed0-402e-9281-e96cf2ea1706 req-395fc940-9d7f-47ed-af66-98375366e279 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039782 Apr 20 05:33:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 77/238] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:10 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:10 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-dd5681c1-eb34-4a61-93ef-48233dcb02c1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 200 len: 1669 microversion: 2.1 time: 0.304124 Apr 20 05:33:10 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:10 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 1669 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-b8e3e33b-5463-4139-ab01-2e8e03f32678 req-db2b129f-0902-4b69-b185-eaeb7edf1ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-b8e3e33b-5463-4139-ab01-2e8e03f32678 req-db2b129f-0902-4b69-b185-eaeb7edf1ad9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-b8e3e33b-5463-4139-ab01-2e8e03f32678 req-db2b129f-0902-4b69-b185-eaeb7edf1ad9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-b8e3e33b-5463-4139-ab01-2e8e03f32678 req-db2b129f-0902-4b69-b185-eaeb7edf1ad9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-b8e3e33b-5463-4139-ab01-2e8e03f32678 req-db2b129f-0902-4b69-b185-eaeb7edf1ad9 service nova] Creating event network-changed:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-b8e3e33b-5463-4139-ab01-2e8e03f32678 req-db2b129f-0902-4b69-b185-eaeb7edf1ad9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032431 Apr 20 05:33:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 82/240] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:11 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:33:11 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-4f430594-2bad-4125-912b-ff2811d1f8db tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 204 len: 0 microversion: 2.1 time: 0.113306 Apr 20 05:33:11 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 78/241] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:33:11 2023] DELETE /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:11 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-1d714eb8-d189-4b6d-8068-a7a24fc0913d req-5d494d9b-376f-401f-a801-73557f41c03a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-1d714eb8-d189-4b6d-8068-a7a24fc0913d req-5d494d9b-376f-401f-a801-73557f41c03a service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-1d714eb8-d189-4b6d-8068-a7a24fc0913d req-5d494d9b-376f-401f-a801-73557f41c03a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-1d714eb8-d189-4b6d-8068-a7a24fc0913d req-5d494d9b-376f-401f-a801-73557f41c03a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-1d714eb8-d189-4b6d-8068-a7a24fc0913d req-5d494d9b-376f-401f-a801-73557f41c03a service nova] Creating event network-vif-unplugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-1d714eb8-d189-4b6d-8068-a7a24fc0913d req-5d494d9b-376f-401f-a801-73557f41c03a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070097 Apr 20 05:33:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 83/242] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1071a61ffe56426997058ad6c6a2c486', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6404b98cd405456f8d4c275b72ef3d94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-2707eed7-53ed-45d6-a8e4-758e1395a5a3 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 200 len: 1662 microversion: 2.1 time: 0.962295 Apr 20 05:33:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 82/243] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:11 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 1662 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-4f413fd9-eeac-499a-9ba0-a5d8a935521c req-43e68080-3a88-41c9-ac6f-8e10289f48e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "name": "network-vif-plugged", "status": "completed", "tag": "d072d509-898e-4552-994c-060638df5951"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-4f413fd9-eeac-499a-9ba0-a5d8a935521c req-43e68080-3a88-41c9-ac6f-8e10289f48e0 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-4f413fd9-eeac-499a-9ba0-a5d8a935521c req-43e68080-3a88-41c9-ac6f-8e10289f48e0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-4f413fd9-eeac-499a-9ba0-a5d8a935521c req-43e68080-3a88-41c9-ac6f-8e10289f48e0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-4f413fd9-eeac-499a-9ba0-a5d8a935521c req-43e68080-3a88-41c9-ac6f-8e10289f48e0 service nova] Creating event network-vif-plugged:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:33:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-4f413fd9-eeac-499a-9ba0-a5d8a935521c req-43e68080-3a88-41c9-ac6f-8e10289f48e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044228 Apr 20 05:33:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 84/244] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:12 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0a5002b4-c129-4ecb-83a8-e8871eea0ccf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.569885 Apr 20 05:33:12 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 79/245] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:12 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:13 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:13 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-618125f9-2604-43b5-a708-f9efc808c40a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.408922 Apr 20 05:33:13 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 83/246] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:12 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:13 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:13 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-583d332c-e88c-4705-b701-68a00c0318b3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.223853 Apr 20 05:33:13 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 85/247] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:33:13 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:14 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de429117-a3ee-46ae-ba8d-4d2d6c9e3089", "name": "network-vif-deleted", "tag": "d072d509-898e-4552-994c-060638df5951"}, {"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-plugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}, {"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-plugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}, {"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-plugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}, {"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-unplugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}, {"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-plugged", "status": "completed", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:14 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:14 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:14 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Creating event network-vif-deleted:d072d509-898e-4552-994c-060638df5951 for instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 on user Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Creating event network-vif-plugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Creating event network-vif-plugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Creating event network-vif-plugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Creating event network-vif-unplugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] Creating event network-vif-plugged:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:14 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-838f96cd-28ef-405d-bad7-7b934ad362f0 req-bd279cb3-751e-4915-9621-a6c1e1158058 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1040 microversion: 2.1 time: 0.037293 Apr 20 05:33:14 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 80/248] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:14 2023] POST /compute/v2.1/os-server-external-events => generated 1040 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:33:14 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-61b4f3e8-e299-4c43-9331-0760c7142f8e req-e0c4dcb5-d94a-451c-94f6-1164e33224d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "627fa30d-3959-4d07-a636-84288d4459a8", "name": "network-vif-deleted", "tag": "f36b2575-04b6-4b84-b8f4-5e0aeb53ad58"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-61b4f3e8-e299-4c43-9331-0760c7142f8e req-e0c4dcb5-d94a-451c-94f6-1164e33224d8 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-61b4f3e8-e299-4c43-9331-0760c7142f8e req-e0c4dcb5-d94a-451c-94f6-1164e33224d8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-61b4f3e8-e299-4c43-9331-0760c7142f8e req-e0c4dcb5-d94a-451c-94f6-1164e33224d8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:14 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-61b4f3e8-e299-4c43-9331-0760c7142f8e req-e0c4dcb5-d94a-451c-94f6-1164e33224d8 service nova] Creating event network-vif-deleted:f36b2575-04b6-4b84-b8f4-5e0aeb53ad58 for instance 627fa30d-3959-4d07-a636-84288d4459a8 on user Apr 20 05:33:14 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-61b4f3e8-e299-4c43-9331-0760c7142f8e req-e0c4dcb5-d94a-451c-94f6-1164e33224d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040226 Apr 20 05:33:14 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 84/249] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=18 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=28 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:54 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-14da2551-7816-42eb-8781-05cfe9723b76 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.332243 Apr 20 05:33:54 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 86/250] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 05:33:54 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022/os-interface => generated 282 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:33:55 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:55 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=16 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=38 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:55 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:55 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-a713e31f-ff4d-42af-99c3-22eb4426f9a2 req-dfc7f961-638b-4026-9d36-1a0bb6c46e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:55 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-a713e31f-ff4d-42af-99c3-22eb4426f9a2 req-dfc7f961-638b-4026-9d36-1a0bb6c46e43 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:55 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-a713e31f-ff4d-42af-99c3-22eb4426f9a2 req-dfc7f961-638b-4026-9d36-1a0bb6c46e43 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:55 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-a713e31f-ff4d-42af-99c3-22eb4426f9a2 req-dfc7f961-638b-4026-9d36-1a0bb6c46e43 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:55 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-a713e31f-ff4d-42af-99c3-22eb4426f9a2 req-dfc7f961-638b-4026-9d36-1a0bb6c46e43 service nova] Creating event network-changed:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:33:55 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-15fa3390-78d9-45e7-b696-ae8b21392a64 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022/ips" status: 200 len: 109 microversion: 2.20 time: 0.044275 Apr 20 05:33:55 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 85/251] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 05:33:55 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022/ips => generated 109 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 05:33:55 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-a713e31f-ff4d-42af-99c3-22eb4426f9a2 req-dfc7f961-638b-4026-9d36-1a0bb6c46e43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101612 Apr 20 05:33:55 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 81/252] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:57 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:33:57 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-6aad8314-4487-41a0-b046-f69eb451e657 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 204 len: 0 microversion: 2.20 time: 0.133892 Apr 20 05:33:57 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 87/253] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:33:57 2023] DELETE /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:57 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4ef040bbdf0346b98a7816a6d0b02cdf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25e3d8c4aae04740b98c807df5434a53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:33:57 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a03c0501-27ce-49d0-a6fe-3be286105b2f tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 200 len: 1712 microversion: 2.20 time: 0.302500 Apr 20 05:33:57 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 86/254] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:33:57 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 1712 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:33:57 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "name": "network-vif-unplugged", "status": "completed", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}, {"server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "name": "network-vif-plugged", "status": "completed", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:57 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] Creating event network-vif-unplugged:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:33:57 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] Creating event network-vif-plugged:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:33:57 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-bb6ac553-da52-44c4-96ac-3d9f62231971 req-bc6c2f67-42ad-4700-aed8-2fc149a7d9eb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033398 Apr 20 05:33:57 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 82/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:57 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:58 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-5027d388-7f98-463c-9371-68f0e51cd52b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.176194 Apr 20 05:33:58 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 88/256] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:33:58 2023] GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf/os-interface => generated 283 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:58 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-7cb6e674-ad72-43f2-a449-7bdb2cc040c1 req-4f45ce0d-d097-45d8-b1e9-6ff968e73a22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe831f98-6da2-44c1-bba4-515d30b4a022", "name": "network-vif-deleted", "tag": "75c70b63-c60f-45f7-acde-61a960acf716"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:58 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-7cb6e674-ad72-43f2-a449-7bdb2cc040c1 req-4f45ce0d-d097-45d8-b1e9-6ff968e73a22 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:58 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-7cb6e674-ad72-43f2-a449-7bdb2cc040c1 req-4f45ce0d-d097-45d8-b1e9-6ff968e73a22 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:58 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-7cb6e674-ad72-43f2-a449-7bdb2cc040c1 req-4f45ce0d-d097-45d8-b1e9-6ff968e73a22 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:58 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-7cb6e674-ad72-43f2-a449-7bdb2cc040c1 req-4f45ce0d-d097-45d8-b1e9-6ff968e73a22 service nova] Creating event network-vif-deleted:75c70b63-c60f-45f7-acde-61a960acf716 for instance fe831f98-6da2-44c1-bba4-515d30b4a022 on user Apr 20 05:33:58 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-7cb6e674-ad72-43f2-a449-7bdb2cc040c1 req-4f45ce0d-d097-45d8-b1e9-6ff968e73a22 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093066 Apr 20 05:33:58 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 87/257] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:33:59 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-754b6670-8b05-455e-8d50-5a80607a5ffe req-b57ff2f7-fd77-4b1e-97b4-1a71e73f8845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:33:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-754b6670-8b05-455e-8d50-5a80607a5ffe req-b57ff2f7-fd77-4b1e-97b4-1a71e73f8845 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:33:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-754b6670-8b05-455e-8d50-5a80607a5ffe req-b57ff2f7-fd77-4b1e-97b4-1a71e73f8845 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:33:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-754b6670-8b05-455e-8d50-5a80607a5ffe req-b57ff2f7-fd77-4b1e-97b4-1a71e73f8845 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:33:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-754b6670-8b05-455e-8d50-5a80607a5ffe req-b57ff2f7-fd77-4b1e-97b4-1a71e73f8845 service nova] Creating event network-changed:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:33:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-754b6670-8b05-455e-8d50-5a80607a5ffe req-b57ff2f7-fd77-4b1e-97b4-1a71e73f8845 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035726 Apr 20 05:33:59 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 83/258] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:33:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:34:00 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 HTTP/1.1 Apr 20 05:34:00 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:00 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:00 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:00 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:00 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:00 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:00 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:00 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:34:00 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:34:00 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:34:00 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:00 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:00 user devstack@n-api.service[72596]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:34:00 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:34:00 user devstack@n-api.service[72596]: method: > Apr 20 05:34:00 user devstack@n-api.service[72596]: exception: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:34:00 user devstack@n-api.service[72596]: action_args: {'id': 'de429117-a3ee-46ae-ba8d-4d2d6c9e3089'} Apr 20 05:34:00 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:34:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-8ee177c7-c94b-4d85-9175-6ed9937138b1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 404 len: 111 microversion: 2.1 time: 0.116292 Apr 20 05:34:00 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 89/259] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:00 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:00 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5386f54c-08da-4e76-bffb-fb390803a23d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '.version_select at 0x7ff302b36170>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:00 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5386f54c-08da-4e76-bffb-fb390803a23d tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040957283" status: 202 len: 0 microversion: 2.1 time: 0.024743 Apr 20 05:34:00 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 88/260] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 05:34:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2040957283 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-268255699", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "31e06cfe-2345-4195-95ac-8e8981df4a22"}]}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] validate_networks() for [('31e06cfe-2345-4195-95ac-8e8981df4a22', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:34:01 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-5721e095-2d84-4266-9459-b55ef5bd0848 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Action: 'create', calling method: .version_select at 0x7ff302827400>, body: {"keypair": {"name": "tempest-keypair-66653533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO5sPsrFgsNmJI2gXFKnMft0wTG7Fg8nW43UMS9/TV1KGxlkKypfKJ+yOgirCG2f8mm5RFrpABRfi2Ey8QbSIPAUrv03Kpg6A2LzhXCHnHm3BwisUYMn/QKH8znj+8Nuhw=="}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:01 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-5721e095-2d84-4266-9459-b55ef5bd0848 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for project c1069c90da8244529aca2b5907e46691. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:34:01 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-5721e095-2d84-4266-9459-b55ef5bd0848 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for user 1558ef8ec15f4bcaa4d8a73bf3b457bc and project c1069c90da8244529aca2b5907e46691. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:34:01 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-5721e095-2d84-4266-9459-b55ef5bd0848 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.055985 Apr 20 05:34:01 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 90/261] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:34:01 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Getting quotas for project 43425b2c00284dc48e18d06e1a8e21e5. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Getting quotas for user 4eb937659897494cb185f8f5ce7f8b22 and project 43425b2c00284dc48e18d06e1a8e21e5. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:34:01 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:34:01 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-eef4b374-38c9-4935-8872-cefbe1fb704a tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.805331 Apr 20 05:34:01 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 84/262] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:34:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:34:01 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5d1fd53f-0b84-44f1-8996-f2514c3f78f7 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:01 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5d1fd53f-0b84-44f1-8996-f2514c3f78f7 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:01 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-5d1fd53f-0b84-44f1-8996-f2514c3f78f7 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb937659897494cb185f8f5ce7f8b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43425b2c00284dc48e18d06e1a8e21e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:01 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5d1fd53f-0b84-44f1-8996-f2514c3f78f7 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956" status: 200 len: 1211 microversion: 2.1 time: 0.102769 Apr 20 05:34:01 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:01 2023] GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:02 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] HTTP exception thrown: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Request method failure captured: Apr 20 05:34:02 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 HTTP/1.1 Apr 20 05:34:02 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:02 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:02 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:02 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:02 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:02 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:02 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:02 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1zuBuFhkx5P0VD9mMlJcHEJ68FqQ7vC8NpNFcl0z6ib2M5hR2ktT4HktMQBNHP-iv3YNL2ILHEq9LsXFadGgivuiCsY7XyN27kdfFiNq07zl7jFKuEGCgAntszWJmOvQo-rclpjO1lRmfSVBxy_0aF4IKZEDm3SLgffWLUj9-iVyc Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Project-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Tenant-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:02 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:02 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:02 user devstack@n-api.service[72596]: X-User-Id: 1071a61ffe56426997058ad6c6a2c486 Apr 20 05:34:02 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:02 user devstack@n-api.service[72596]: method: > Apr 20 05:34:02 user devstack@n-api.service[72596]: exception: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:02 user devstack@n-api.service[72596]: action_args: {'id': '627fa30d-3959-4d07-a636-84288d4459a8'} Apr 20 05:34:02 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:02 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:02 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Returning 404 to user: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:02 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-3027dc23-7162-4d19-965f-c47d46d32acf tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 404 len: 111 microversion: 2.1 time: 0.132868 Apr 20 05:34:02 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 91/264] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:02 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:02 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-3e9fa876-1450-43ce-bbca-d2ecef6fb600 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '.version_select at 0x7ff3029a76d0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:02 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-3e9fa876-1450-43ce-bbca-d2ecef6fb600 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422048262" status: 202 len: 0 microversion: 2.1 time: 0.036928 Apr 20 05:34:02 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 85/265] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 05:34:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422048262 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:02 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:02 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-452a885a-f16f-4256-9720-3f23bafb65a6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1493 microversion: 2.1 time: 0.257628 Apr 20 05:34:02 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 90/266] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:02 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1493 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] HTTP exception thrown: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Request method failure captured: Apr 20 05:34:03 user devstack@n-api.service[72596]: request: DELETE /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 HTTP/1.1 Apr 20 05:34:03 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:03 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:03 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:03 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:03 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:03 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:03 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:03 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1zuBuFhkx5P0VD9mMlJcHEJ68FqQ7vC8NpNFcl0z6ib2M5hR2ktT4HktMQBNHP-iv3YNL2ILHEq9LsXFadGgivuiCsY7XyN27kdfFiNq07zl7jFKuEGCgAntszWJmOvQo-rclpjO1lRmfSVBxy_0aF4IKZEDm3SLgffWLUj9-iVyc Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Tenant-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Id: 1071a61ffe56426997058ad6c6a2c486 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72596]: method: > Apr 20 05:34:03 user devstack@n-api.service[72596]: exception: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: action_args: {'id': '627fa30d-3959-4d07-a636-84288d4459a8'} Apr 20 05:34:03 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Returning 404 to user: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-a8215cd6-6348-4875-b9c8-47efdb1db616 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 404 len: 111 microversion: 2.1 time: 0.031555 Apr 20 05:34:03 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 92/267] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:34:03 2023] DELETE /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: 627fa30d-3959-4d07-a636-84288d4459a8] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1024067320", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "095a8a82-6992-4f8a-b50b-f67a659d9247"}], "security_groups": [{"name": "tempest-securitygroup--444744393"}], "key_name": "tempest-keypair-66653533", "user_data": "}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] HTTP exception thrown: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Request method failure captured: Apr 20 05:34:03 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 HTTP/1.1 Apr 20 05:34:03 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:34:03 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:34:03 user devstack@n-api.service[72598]: Connection: close Apr 20 05:34:03 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:34:03 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:34:03 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:34:03 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:34:03 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM1zuBuFhkx5P0VD9mMlJcHEJ68FqQ7vC8NpNFcl0z6ib2M5hR2ktT4HktMQBNHP-iv3YNL2ILHEq9LsXFadGgivuiCsY7XyN27kdfFiNq07zl7jFKuEGCgAntszWJmOvQo-rclpjO1lRmfSVBxy_0aF4IKZEDm3SLgffWLUj9-iVyc Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Tenant: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Tenant-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Id: 1071a61ffe56426997058ad6c6a2c486 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Name: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72598]: method: > Apr 20 05:34:03 user devstack@n-api.service[72598]: exception: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: action_args: {'id': '627fa30d-3959-4d07-a636-84288d4459a8'} Apr 20 05:34:03 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Returning 404 to user: Instance 627fa30d-3959-4d07-a636-84288d4459a8 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-1cd5622e-5776-4e49-9377-effba2af7925 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8" status: 404 len: 111 microversion: 2.1 time: 0.039451 Apr 20 05:34:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 86/268] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:03 2023] GET /compute/v2.1/servers/627fa30d-3959-4d07-a636-84288d4459a8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:03 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] validate_networks() for [('095a8a82-6992-4f8a-b50b-f67a659d9247', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] HTTP exception thrown: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Request method failure captured: Apr 20 05:34:03 user devstack@n-api.service[72596]: request: DELETE /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 HTTP/1.1 Apr 20 05:34:03 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:03 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:03 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:03 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:03 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:03 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:03 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:03 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1zuBuFhkx5P0VD9mMlJcHEJ68FqQ7vC8NpNFcl0z6ib2M5hR2ktT4HktMQBNHP-iv3YNL2ILHEq9LsXFadGgivuiCsY7XyN27kdfFiNq07zl7jFKuEGCgAntszWJmOvQo-rclpjO1lRmfSVBxy_0aF4IKZEDm3SLgffWLUj9-iVyc Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Tenant-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Id: 1071a61ffe56426997058ad6c6a2c486 Apr 20 05:34:03 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72596]: method: > Apr 20 05:34:03 user devstack@n-api.service[72596]: exception: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: action_args: {'id': 'd5698511-ae0b-4340-a5bb-6a19a9c17dd0'} Apr 20 05:34:03 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Returning 404 to user: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-1fb620b5-eb77-43bc-91cb-b2e3eccac391 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 404 len: 111 microversion: 2.1 time: 0.041189 Apr 20 05:34:03 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 93/269] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:34:03 2023] DELETE /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] [instance: d5698511-ae0b-4340-a5bb-6a19a9c17dd0] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] HTTP exception thrown: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Request method failure captured: Apr 20 05:34:03 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 HTTP/1.1 Apr 20 05:34:03 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:34:03 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:34:03 user devstack@n-api.service[72598]: Connection: close Apr 20 05:34:03 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:34:03 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:34:03 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:34:03 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:34:03 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM1zuBuFhkx5P0VD9mMlJcHEJ68FqQ7vC8NpNFcl0z6ib2M5hR2ktT4HktMQBNHP-iv3YNL2ILHEq9LsXFadGgivuiCsY7XyN27kdfFiNq07zl7jFKuEGCgAntszWJmOvQo-rclpjO1lRmfSVBxy_0aF4IKZEDm3SLgffWLUj9-iVyc Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Project-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6404b98cd405456f8d4c275b72ef3d94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Tenant: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Tenant-Id: 6404b98cd405456f8d4c275b72ef3d94 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1004159936 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Id: 1071a61ffe56426997058ad6c6a2c486 Apr 20 05:34:03 user devstack@n-api.service[72598]: X-User-Name: tempest-AttachVolumeTestJSON-1004159936-project-member Apr 20 05:34:03 user devstack@n-api.service[72598]: method: > Apr 20 05:34:03 user devstack@n-api.service[72598]: exception: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: action_args: {'id': 'd5698511-ae0b-4340-a5bb-6a19a9c17dd0'} Apr 20 05:34:03 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. Apr 20 05:34:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] Returning 404 to user: Instance d5698511-ae0b-4340-a5bb-6a19a9c17dd0 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-5a4f97de-958d-4e6a-8b7c-a916ba46fb96 tempest-AttachVolumeTestJSON-1004159936 tempest-AttachVolumeTestJSON-1004159936-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0" status: 404 len: 111 microversion: 2.1 time: 0.027380 Apr 20 05:34:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 87/270] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:03 2023] GET /compute/v2.1/servers/d5698511-ae0b-4340-a5bb-6a19a9c17dd0 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for project c1069c90da8244529aca2b5907e46691. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Getting quotas for user 1558ef8ec15f4bcaa4d8a73bf3b457bc and project c1069c90da8244529aca2b5907e46691. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:34:04 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:34:04 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7a5f7d4f-1800-4129-ac3a-7be0e1cc8150 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.724519 Apr 20 05:34:04 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 91/271] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:34:03 2023] POST /compute/v2.1/servers => generated 399 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:34:04 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-e7ef8b2a-e48a-4c55-bfef-30e41778bbc8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:04 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-e7ef8b2a-e48a-4c55-bfef-30e41778bbc8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:04 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-e7ef8b2a-e48a-4c55-bfef-30e41778bbc8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:04 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-e7ef8b2a-e48a-4c55-bfef-30e41778bbc8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 200 len: 1234 microversion: 2.1 time: 0.091808 Apr 20 05:34:04 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 94/272] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:04 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:04 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-cae271ca-eac6-4f60-bd7f-2f519b66698b req-61d62202-429e-4ae7-bbf2-9a7e8b3f6869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-cae271ca-eac6-4f60-bd7f-2f519b66698b req-61d62202-429e-4ae7-bbf2-9a7e8b3f6869 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-cae271ca-eac6-4f60-bd7f-2f519b66698b req-61d62202-429e-4ae7-bbf2-9a7e8b3f6869 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-cae271ca-eac6-4f60-bd7f-2f519b66698b req-61d62202-429e-4ae7-bbf2-9a7e8b3f6869 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:04 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-cae271ca-eac6-4f60-bd7f-2f519b66698b req-61d62202-429e-4ae7-bbf2-9a7e8b3f6869 service nova] Creating event network-changed:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:34:04 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-cae271ca-eac6-4f60-bd7f-2f519b66698b req-61d62202-429e-4ae7-bbf2-9a7e8b3f6869 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042462 Apr 20 05:34:04 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 88/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:06 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-8ab3c052-9851-4d1b-8ff9-f6ad09f0f95d req-57ac516b-c6f7-4675-9d87-b39b72a75fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-plugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-8ab3c052-9851-4d1b-8ff9-f6ad09f0f95d req-57ac516b-c6f7-4675-9d87-b39b72a75fe4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-8ab3c052-9851-4d1b-8ff9-f6ad09f0f95d req-57ac516b-c6f7-4675-9d87-b39b72a75fe4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:06 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-8ab3c052-9851-4d1b-8ff9-f6ad09f0f95d req-57ac516b-c6f7-4675-9d87-b39b72a75fe4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:06 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-8ab3c052-9851-4d1b-8ff9-f6ad09f0f95d req-57ac516b-c6f7-4675-9d87-b39b72a75fe4 service nova] Creating event network-vif-plugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:34:06 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-8ab3c052-9851-4d1b-8ff9-f6ad09f0f95d req-57ac516b-c6f7-4675-9d87-b39b72a75fe4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042905 Apr 20 05:34:06 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:06 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:34:07 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-247695e8-812a-45e2-bb13-d1474fe580a5 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 204 len: 0 microversion: 2.1 time: 0.117441 Apr 20 05:34:07 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 95/275] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:34:06 2023] DELETE /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-3b94d43f-9b48-43a5-aca0-53e1d17e48c7 req-4f3e790b-5a44-4b77-8979-a4b4ea1fa8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-3b94d43f-9b48-43a5-aca0-53e1d17e48c7 req-4f3e790b-5a44-4b77-8979-a4b4ea1fa8f4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-3b94d43f-9b48-43a5-aca0-53e1d17e48c7 req-4f3e790b-5a44-4b77-8979-a4b4ea1fa8f4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-3b94d43f-9b48-43a5-aca0-53e1d17e48c7 req-4f3e790b-5a44-4b77-8979-a4b4ea1fa8f4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-3b94d43f-9b48-43a5-aca0-53e1d17e48c7 req-4f3e790b-5a44-4b77-8979-a4b4ea1fa8f4 service nova] Creating event network-changed:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:34:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-3b94d43f-9b48-43a5-aca0-53e1d17e48c7 req-4f3e790b-5a44-4b77-8979-a4b4ea1fa8f4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204486 Apr 20 05:34:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 93/276] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:07 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:07 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0a9b723f-5c8b-4f99-b97b-c6e8d0678534 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 200 len: 1495 microversion: 2.1 time: 0.324349 Apr 20 05:34:07 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 89/277] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:07 2023] GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 1495 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-40d47607-d151-4258-ac7a-ebe3f07e943f tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Action: 'create', calling method: .version_select at 0x7ff3028252d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-752296871"}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:08 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-40d47607-d151-4258-ac7a-ebe3f07e943f tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.453570 Apr 20 05:34:08 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 96/278] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 05:34:08 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 455 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 05:34:08 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-6e9c4ab0-704e-4b3f-b58e-10d7b765528e tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Calling method '.version_select at 0x7ff302b365f0>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:08 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-6e9c4ab0-704e-4b3f-b58e-10d7b765528e tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619" status: 200 len: 344 microversion: 2.1 time: 0.069136 Apr 20 05:34:08 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 94/279] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:34:08 2023] GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:08 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-plugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}, {"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-deleted", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:08 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:08 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] Creating event network-vif-plugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:34:08 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] Creating event network-vif-deleted:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:34:08 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-395ca0f1-ef13-4ec4-a90e-80166287c3a8 req-f49a4897-fe6e-4e40-a838-a688b08e6769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039562 Apr 20 05:34:08 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 90/280] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-unplugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}, {"server_uuid": "ab7a2c49-e524-4472-82c7-5046bd66d9b3", "name": "network-vif-plugged", "status": "completed", "tag": "5e4aa35c-9190-4f49-ad52-13c3326d705e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] Creating event network-vif-unplugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:34:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] Creating event network-vif-plugged:5e4aa35c-9190-4f49-ad52-13c3326d705e for instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 on user Apr 20 05:34:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-620269be-ff34-4cb3-b47c-ec9bb1d26ab3 req-a2386abd-8de7-4802-a206-f147eb073ab1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.031053 Apr 20 05:34:09 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 97/281] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:09 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-d09edc54-089d-4027-858e-1412e00f9e92 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Calling method '.version_select at 0x7ff3029cee60>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-d09edc54-089d-4027-858e-1412e00f9e92 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619" status: 200 len: 341 microversion: 2.1 time: 0.059313 Apr 20 05:34:09 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 95/282] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:34:09 2023] GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619 => generated 341 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-e4dac665-0edd-4bba-ab77-d00ac328bc65 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Calling method '.version_select at 0x7ff3029a77f0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-e4dac665-0edd-4bba-ab77-d00ac328bc65 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619" status: 202 len: 0 microversion: 2.1 time: 0.175457 Apr 20 05:34:09 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 91/283] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:34:09 2023] DELETE /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:34:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-060effb3-2c62-47d2-8325-3c6a10fad8c4 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Calling method '.version_select at 0x7ff302826560>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-060effb3-2c62-47d2-8325-3c6a10fad8c4 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] HTTP exception thrown: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. Apr 20 05:34:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-060effb3-2c62-47d2-8325-3c6a10fad8c4 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Request method failure captured: Apr 20 05:34:10 user devstack@n-api.service[72596]: request: GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619 HTTP/1.1 Apr 20 05:34:10 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:10 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:10 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:10 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:10 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:10 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:10 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:10 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM7QouXrh6yE7gZmeY4zpvVb3-s6hx-LCAmkwhYO7d8x00nY-YhxI8yausgreNQNkXaUKoJD1VgM7spHe5VCcjI_nruGbOwd0VLJtTMXN7y1_-gt0jfZqPQw591WoW7OxxthxuiGozmGu8ZGV4hIbQLU97ePLlre0DIm9XlnhGgDUtY Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Project-Id: 91b95a64949b463580041c2ed4ee9983 Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2090049998 Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91b95a64949b463580041c2ed4ee9983"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/91b95a64949b463580041c2ed4ee9983"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/91b95a64949b463580041c2ed4ee9983"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2090049998 Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Tenant-Id: 91b95a64949b463580041c2ed4ee9983 Apr 20 05:34:10 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2090049998 Apr 20 05:34:10 user devstack@n-api.service[72596]: X-User: tempest-VolumesSnapshotsTestJSON-2090049998-project-member Apr 20 05:34:10 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:10 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:10 user devstack@n-api.service[72596]: X-User-Id: 2009d7754e4a4838b2c8d4661040602c Apr 20 05:34:10 user devstack@n-api.service[72596]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2090049998-project-member Apr 20 05:34:10 user devstack@n-api.service[72596]: method: Apr 20 05:34:10 user devstack@n-api.service[72596]: exception: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. Apr 20 05:34:10 user devstack@n-api.service[72596]: action_args: {'id': '27d71b12-b3d0-4512-b36c-989ff28e7619'} Apr 20 05:34:10 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. (HTTP 404) (Request-ID: req-69345d5a-e52d-47bb-97e8-2c7e6ff62405) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. Apr 20 05:34:10 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-060effb3-2c62-47d2-8325-3c6a10fad8c4 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] Returning 404 to user: Volume 27d71b12-b3d0-4512-b36c-989ff28e7619 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-060effb3-2c62-47d2-8325-3c6a10fad8c4 tempest-VolumesSnapshotsTestJSON-2090049998 tempest-VolumesSnapshotsTestJSON-2090049998-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619" status: 404 len: 109 microversion: 2.1 time: 0.043227 Apr 20 05:34:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 98/284] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:34:09 2023] GET /compute/v2.1/os-volumes/27d71b12-b3d0-4512-b36c-989ff28e7619 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-158556952"}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:10 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "name": "network-vif-plugged", "status": "completed", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}, {"server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "name": "network-vif-plugged", "status": "completed", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] Creating event network-vif-plugged:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:34:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] Creating event network-vif-plugged:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:34:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-ec757a73-bdad-49af-8aaf-2af0d529b8cd req-a3c79b7a-1bb2-4473-aa8f-e98fc437cc92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044689 Apr 20 05:34:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 92/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:10 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:11 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7e229a86-f12d-46db-99df-6e2dcbc09ca9 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "POST /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084/action" status: 202 len: 52 microversion: 2.87 time: 1.005205 Apr 20 05:34:11 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 96/286] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 05:34:10 2023] POST /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084/action => generated 52 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-9ee7339e-3c71-4dec-8b62-d6b6d9cb699a tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Action: 'create', calling method: .version_select at 0x7ff302826cb0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1747897172", "metadata": {"Type": "work"}}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-9ee7339e-3c71-4dec-8b62-d6b6d9cb699a tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Request method failure captured: Apr 20 05:34:12 user devstack@n-api.service[72596]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 05:34:12 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:12 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:12 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:12 user devstack@n-api.service[72596]: Content-Length: 122 Apr 20 05:34:12 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:12 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:12 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:12 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM7TZJ6o1_DGLtnenZCRvL_hKDLnY8m5VUjXoW8kMtX32WcqB4PQREgmohlPQ0XMPQzhE9faAKTZP2zobTfXU3be0qGX12AuSOJxp3enpASi0ybWRMQQBY-_6JKQBYIhQR8zuqXzofBgWRoYjE5tXucYdZRA-CaURa-zWlqGpPq5dXo Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Id: 4fe86c7ae23243608440079efc8ebbc7 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Name: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72596]: Apr 20 05:34:12 user devstack@n-api.service[72596]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1747897172", "metadata": {"Type": "work"}}} Apr 20 05:34:12 user devstack@n-api.service[72596]: method: Apr 20 05:34:12 user devstack@n-api.service[72596]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72596]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1747897172', 'metadata': {'Type': 'work'}}}} Apr 20 05:34:12 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise error Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-9ee7339e-3c71-4dec-8b62-d6b6d9cb699a tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-9ee7339e-3c71-4dec-8b62-d6b6d9cb699a tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.176581 Apr 20 05:34:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 99/287] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 05:34:12 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b415942a-ac33-4335-9446-42dcfc7358d7 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Action: 'create', calling method: .version_select at 0x7ff3029a7250>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1503319361", "metadata": {"Type": "work"}}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b415942a-ac33-4335-9446-42dcfc7358d7 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Request method failure captured: Apr 20 05:34:12 user devstack@n-api.service[72598]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 05:34:12 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:34:12 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:34:12 user devstack@n-api.service[72598]: Connection: close Apr 20 05:34:12 user devstack@n-api.service[72598]: Content-Length: 120 Apr 20 05:34:12 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:34:12 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:34:12 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:34:12 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM7TZJ6o1_DGLtnenZCRvL_hKDLnY8m5VUjXoW8kMtX32WcqB4PQREgmohlPQ0XMPQzhE9faAKTZP2zobTfXU3be0qGX12AuSOJxp3enpASi0ybWRMQQBY-_6JKQBYIhQR8zuqXzofBgWRoYjE5tXucYdZRA-CaURa-zWlqGpPq5dXo Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Tenant: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Tenant-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Id: 4fe86c7ae23243608440079efc8ebbc7 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Name: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72598]: Apr 20 05:34:12 user devstack@n-api.service[72598]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1503319361", "metadata": {"Type": "work"}}} Apr 20 05:34:12 user devstack@n-api.service[72598]: method: Apr 20 05:34:12 user devstack@n-api.service[72598]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 05:34:12 user devstack@n-api.service[72598]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1503319361', 'metadata': {'Type': 'work'}}}} Apr 20 05:34:12 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise error Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi '0' Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b415942a-ac33-4335-9446-42dcfc7358d7 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-b415942a-ac33-4335-9446-42dcfc7358d7 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016411 Apr 20 05:34:12 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 93/288] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 05:34:12 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5a72ff51-bbda-424f-adca-c86da4472596 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Action: 'create', calling method: .version_select at 0x7ff302be3eb0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-955922824", "metadata": {"Type": "work"}}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5a72ff51-bbda-424f-adca-c86da4472596 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Request method failure captured: Apr 20 05:34:12 user devstack@n-api.service[72597]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 05:34:12 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:34:12 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:34:12 user devstack@n-api.service[72597]: Connection: close Apr 20 05:34:12 user devstack@n-api.service[72597]: Content-Length: 118 Apr 20 05:34:12 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:34:12 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:34:12 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:34:12 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM7TZJ6o1_DGLtnenZCRvL_hKDLnY8m5VUjXoW8kMtX32WcqB4PQREgmohlPQ0XMPQzhE9faAKTZP2zobTfXU3be0qGX12AuSOJxp3enpASi0ybWRMQQBY-_6JKQBYIhQR8zuqXzofBgWRoYjE5tXucYdZRA-CaURa-zWlqGpPq5dXo Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Project-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Project-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Tenant: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Tenant-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-User: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72597]: X-User-Id: 4fe86c7ae23243608440079efc8ebbc7 Apr 20 05:34:12 user devstack@n-api.service[72597]: X-User-Name: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72597]: Apr 20 05:34:12 user devstack@n-api.service[72597]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-955922824", "metadata": {"Type": "work"}}} Apr 20 05:34:12 user devstack@n-api.service[72597]: method: Apr 20 05:34:12 user devstack@n-api.service[72597]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72597]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-955922824', 'metadata': {'Type': 'work'}}}} Apr 20 05:34:12 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise error Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi '' Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 05:34:12 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5a72ff51-bbda-424f-adca-c86da4472596 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5a72ff51-bbda-424f-adca-c86da4472596 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012122 Apr 20 05:34:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 97/289] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 05:34:12 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-98136d68-63ce-4287-b855-783de9f63af2 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Calling method '.version_select at 0x7ff3028252d0>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-98136d68-63ce-4287-b855-783de9f63af2 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] HTTP exception thrown: Volume tempest-invalid-426315617 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-98136d68-63ce-4287-b855-783de9f63af2 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Request method failure captured: Apr 20 05:34:12 user devstack@n-api.service[72596]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-426315617 HTTP/1.1 Apr 20 05:34:12 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:12 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:12 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:12 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:12 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:12 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:12 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:12 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM7TZJ6o1_DGLtnenZCRvL_hKDLnY8m5VUjXoW8kMtX32WcqB4PQREgmohlPQ0XMPQzhE9faAKTZP2zobTfXU3be0qGX12AuSOJxp3enpASi0ybWRMQQBY-_6JKQBYIhQR8zuqXzofBgWRoYjE5tXucYdZRA-CaURa-zWlqGpPq5dXo Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Id: 4fe86c7ae23243608440079efc8ebbc7 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Name: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72596]: method: Apr 20 05:34:12 user devstack@n-api.service[72596]: exception: Volume tempest-invalid-426315617 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: action_args: {'id': 'tempest-invalid-426315617'} Apr 20 05:34:12 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-426315617 could not be found. (HTTP 404) (Request-ID: req-ee95ea79-3fa3-4c02-bfdd-46b0259aa533) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-426315617 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-426315617 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-426315617 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-98136d68-63ce-4287-b855-783de9f63af2 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Returning 404 to user: Volume tempest-invalid-426315617 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-98136d68-63ce-4287-b855-783de9f63af2 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-426315617" status: 404 len: 98 microversion: 2.1 time: 0.039891 Apr 20 05:34:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 100/290] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 05:34:12 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-426315617 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-8a856a61-4ae8-4a3c-ac59-9b3e7f2c0d0c tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007873 Apr 20 05:34:12 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 94/291] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 05:34:12 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-216dc180-c2e1-4f4c-b3ae-dc3e9f7bbb99 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004570 Apr 20 05:34:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 98/292] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 05:34:12 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b764dcde-f1ae-4fda-8e3b-c53b213e8fd3 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Calling method '.version_select at 0x7ff302826680>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-b764dcde-f1ae-4fda-8e3b-c53b213e8fd3 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] HTTP exception thrown: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b764dcde-f1ae-4fda-8e3b-c53b213e8fd3 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Request method failure captured: Apr 20 05:34:12 user devstack@n-api.service[72596]: request: DELETE /compute/v2.1/os-volumes/813a08c7-6909-458c-8657-2351eb4c0889 HTTP/1.1 Apr 20 05:34:12 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:12 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:12 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:12 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:12 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:12 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:12 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:12 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM7TZJ6o1_DGLtnenZCRvL_hKDLnY8m5VUjXoW8kMtX32WcqB4PQREgmohlPQ0XMPQzhE9faAKTZP2zobTfXU3be0qGX12AuSOJxp3enpASi0ybWRMQQBY-_6JKQBYIhQR8zuqXzofBgWRoYjE5tXucYdZRA-CaURa-zWlqGpPq5dXo Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Project-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Id: 4fe86c7ae23243608440079efc8ebbc7 Apr 20 05:34:12 user devstack@n-api.service[72596]: X-User-Name: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72596]: method: Apr 20 05:34:12 user devstack@n-api.service[72596]: exception: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: action_args: {'id': '813a08c7-6909-458c-8657-2351eb4c0889'} Apr 20 05:34:12 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. (HTTP 404) (Request-ID: req-5a0b6a4d-06ca-44f1-9605-001b57d3563d) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b764dcde-f1ae-4fda-8e3b-c53b213e8fd3 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Returning 404 to user: Volume 813a08c7-6909-458c-8657-2351eb4c0889 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b764dcde-f1ae-4fda-8e3b-c53b213e8fd3 tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/813a08c7-6909-458c-8657-2351eb4c0889" status: 404 len: 109 microversion: 2.1 time: 0.037564 Apr 20 05:34:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 101/293] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:34:12 2023] DELETE /compute/v2.1/os-volumes/813a08c7-6909-458c-8657-2351eb4c0889 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5cdbde02-d170-404a-b185-e20c6211f5ce tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Calling method '.version_select at 0x7ff3040d9090>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-5cdbde02-d170-404a-b185-e20c6211f5ce tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] HTTP exception thrown: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5cdbde02-d170-404a-b185-e20c6211f5ce tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Request method failure captured: Apr 20 05:34:12 user devstack@n-api.service[72598]: request: GET /compute/v2.1/os-volumes/7a74c887-ea76-44b0-8e66-28d273589ac1 HTTP/1.1 Apr 20 05:34:12 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:34:12 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:34:12 user devstack@n-api.service[72598]: Connection: close Apr 20 05:34:12 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:34:12 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:34:12 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:34:12 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:34:12 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM7TZJ6o1_DGLtnenZCRvL_hKDLnY8m5VUjXoW8kMtX32WcqB4PQREgmohlPQ0XMPQzhE9faAKTZP2zobTfXU3be0qGX12AuSOJxp3enpASi0ybWRMQQBY-_6JKQBYIhQR8zuqXzofBgWRoYjE5tXucYdZRA-CaURa-zWlqGpPq5dXo Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Project-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e10680ae04c3496eba2725b016e5b130"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Tenant: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Tenant-Id: e10680ae04c3496eba2725b016e5b130 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-VolumesNegativeTest-1493306974 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Id: 4fe86c7ae23243608440079efc8ebbc7 Apr 20 05:34:12 user devstack@n-api.service[72598]: X-User-Name: tempest-VolumesNegativeTest-1493306974-project-member Apr 20 05:34:12 user devstack@n-api.service[72598]: method: Apr 20 05:34:12 user devstack@n-api.service[72598]: exception: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72598]: action_args: {'id': '7a74c887-ea76-44b0-8e66-28d273589ac1'} Apr 20 05:34:12 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. (HTTP 404) (Request-ID: req-321e5350-d57e-4d14-9a93-d7b49924c360) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. Apr 20 05:34:12 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5cdbde02-d170-404a-b185-e20c6211f5ce tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] Returning 404 to user: Volume 7a74c887-ea76-44b0-8e66-28d273589ac1 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-5cdbde02-d170-404a-b185-e20c6211f5ce tempest-VolumesNegativeTest-1493306974 tempest-VolumesNegativeTest-1493306974-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/7a74c887-ea76-44b0-8e66-28d273589ac1" status: 404 len: 109 microversion: 2.1 time: 0.040085 Apr 20 05:34:12 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 95/294] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 05:34:12 2023] GET /compute/v2.1/os-volumes/7a74c887-ea76-44b0-8e66-28d273589ac1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=8 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:15 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:15 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-e769adc8-1466-4416-a187-e7a4870d4e0f tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.283646 Apr 20 05:34:15 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 99/295] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:15 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:17 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:17 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-90679d23-9503-40b6-beae-c8446f4e532e tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084" status: 200 len: 1689 microversion: 2.87 time: 0.228565 Apr 20 05:34:17 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 102/296] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:34:17 2023] GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 => generated 1689 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=24 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:47 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] HTTP exception thrown: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Request method failure captured: Apr 20 05:34:47 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 HTTP/1.1 Apr 20 05:34:47 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:34:47 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:34:47 user devstack@n-api.service[72598]: Connection: close Apr 20 05:34:47 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:34:47 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:34:47 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:34:47 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:34:47 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM2p1JEq61Mr_-iHTrn1UL4kG1V5eQj3EaelS9qGo-1LnsZFnPDq_Ll3X6i2VSy6dGPk4OxQt184_xkIrc-UDrOHCSnRcdCWwjSIhyU2DTLFaKVH_7Co8vnYkg1MNxEcjH8XPTMtSaukOTBlvKpNuhFykE9ojaNROtutG4mkY5H8MC0 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Project-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Tenant-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:47 user devstack@n-api.service[72598]: X-User: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:47 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:34:47 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:34:47 user devstack@n-api.service[72598]: X-User-Id: 4ef040bbdf0346b98a7816a6d0b02cdf Apr 20 05:34:47 user devstack@n-api.service[72598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:47 user devstack@n-api.service[72598]: method: > Apr 20 05:34:47 user devstack@n-api.service[72598]: exception: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:47 user devstack@n-api.service[72598]: action_args: {'id': 'fe831f98-6da2-44c1-bba4-515d30b4a022'} Apr 20 05:34:47 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:47 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:47 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Returning 404 to user: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:47 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-ddaef59e-c955-4224-bdb8-e1ebb1bc38a5 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 404 len: 111 microversion: 2.20 time: 0.270261 Apr 20 05:34:47 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 96/297] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:34:47 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 111 bytes in 272 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:34:47 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-0d196925-f024-46cb-9d9a-b12751f7c9b4 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '.version_select at 0x7ff3029cdfc0>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:47 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:47 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:48 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-0d196925-f024-46cb-9d9a-b12751f7c9b4 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467630871" status: 204 len: 0 microversion: 2.20 time: 0.028368 Apr 20 05:34:48 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 100/298] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 05:34:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1467630871 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:48 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] HTTP exception thrown: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Request method failure captured: Apr 20 05:34:48 user devstack@n-api.service[72596]: request: DELETE /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 HTTP/1.1 Apr 20 05:34:48 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:48 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:48 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:48 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:48 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:48 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:48 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:48 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM2p1JEq61Mr_-iHTrn1UL4kG1V5eQj3EaelS9qGo-1LnsZFnPDq_Ll3X6i2VSy6dGPk4OxQt184_xkIrc-UDrOHCSnRcdCWwjSIhyU2DTLFaKVH_7Co8vnYkg1MNxEcjH8XPTMtSaukOTBlvKpNuhFykE9ojaNROtutG4mkY5H8MC0 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Project-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Tenant-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:48 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:48 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:48 user devstack@n-api.service[72596]: X-User-Id: 4ef040bbdf0346b98a7816a6d0b02cdf Apr 20 05:34:48 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:48 user devstack@n-api.service[72596]: method: > Apr 20 05:34:48 user devstack@n-api.service[72596]: exception: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72596]: action_args: {'id': 'fe831f98-6da2-44c1-bba4-515d30b4a022'} Apr 20 05:34:48 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Returning 404 to user: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:48 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b1876ce9-92ee-484f-b41d-c93810e11da3 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 404 len: 111 microversion: 2.20 time: 0.038938 Apr 20 05:34:48 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 103/299] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:34:48 2023] DELETE /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: fe831f98-6da2-44c1-bba4-515d30b4a022] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:48 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] HTTP exception thrown: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Request method failure captured: Apr 20 05:34:48 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 HTTP/1.1 Apr 20 05:34:48 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:34:48 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:34:48 user devstack@n-api.service[72598]: Connection: close Apr 20 05:34:48 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:34:48 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:34:48 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:34:48 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:34:48 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM2p1JEq61Mr_-iHTrn1UL4kG1V5eQj3EaelS9qGo-1LnsZFnPDq_Ll3X6i2VSy6dGPk4OxQt184_xkIrc-UDrOHCSnRcdCWwjSIhyU2DTLFaKVH_7Co8vnYkg1MNxEcjH8XPTMtSaukOTBlvKpNuhFykE9ojaNROtutG4mkY5H8MC0 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Project-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Tenant-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72598]: X-User: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:48 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:34:48 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:34:48 user devstack@n-api.service[72598]: X-User-Id: 4ef040bbdf0346b98a7816a6d0b02cdf Apr 20 05:34:48 user devstack@n-api.service[72598]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:48 user devstack@n-api.service[72598]: method: > Apr 20 05:34:48 user devstack@n-api.service[72598]: exception: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72598]: action_args: {'id': 'fe831f98-6da2-44c1-bba4-515d30b4a022'} Apr 20 05:34:48 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. Apr 20 05:34:48 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Returning 404 to user: Instance fe831f98-6da2-44c1-bba4-515d30b4a022 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:48 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-14c823b5-541d-45d6-b233-a722947681ed tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022" status: 404 len: 111 microversion: 2.20 time: 0.028255 Apr 20 05:34:48 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 97/300] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:34:48 2023] GET /compute/v2.1/servers/fe831f98-6da2-44c1-bba4-515d30b4a022 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:48 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] HTTP exception thrown: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Request method failure captured: Apr 20 05:34:48 user devstack@n-api.service[72597]: request: DELETE /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a HTTP/1.1 Apr 20 05:34:48 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:34:48 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:34:48 user devstack@n-api.service[72597]: Connection: close Apr 20 05:34:48 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:34:48 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:34:48 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:34:48 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:34:48 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM2p1JEq61Mr_-iHTrn1UL4kG1V5eQj3EaelS9qGo-1LnsZFnPDq_Ll3X6i2VSy6dGPk4OxQt184_xkIrc-UDrOHCSnRcdCWwjSIhyU2DTLFaKVH_7Co8vnYkg1MNxEcjH8XPTMtSaukOTBlvKpNuhFykE9ojaNROtutG4mkY5H8MC0 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Project-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Tenant-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:48 user devstack@n-api.service[72597]: X-User: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:48 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:34:48 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:34:48 user devstack@n-api.service[72597]: X-User-Id: 4ef040bbdf0346b98a7816a6d0b02cdf Apr 20 05:34:48 user devstack@n-api.service[72597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:48 user devstack@n-api.service[72597]: method: > Apr 20 05:34:48 user devstack@n-api.service[72597]: exception: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:48 user devstack@n-api.service[72597]: action_args: {'id': '5840d3e8-bf88-40d9-a864-03fb8c090e1a'} Apr 20 05:34:48 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:34:49 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Returning 404 to user: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:49 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-83a324ec-f910-4883-a081-f50b63abc9f2 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 404 len: 111 microversion: 2.20 time: 0.038135 Apr 20 05:34:49 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 101/301] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:34:48 2023] DELETE /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] [instance: 5840d3e8-bf88-40d9-a864-03fb8c090e1a] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:49 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] HTTP exception thrown: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Request method failure captured: Apr 20 05:34:49 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a HTTP/1.1 Apr 20 05:34:49 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:49 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:49 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:49 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:49 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:49 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:49 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:49 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM2p1JEq61Mr_-iHTrn1UL4kG1V5eQj3EaelS9qGo-1LnsZFnPDq_Ll3X6i2VSy6dGPk4OxQt184_xkIrc-UDrOHCSnRcdCWwjSIhyU2DTLFaKVH_7Co8vnYkg1MNxEcjH8XPTMtSaukOTBlvKpNuhFykE9ojaNROtutG4mkY5H8MC0 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Project-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/25e3d8c4aae04740b98c807df5434a53"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Tenant-Id: 25e3d8c4aae04740b98c807df5434a53 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-760805304 Apr 20 05:34:49 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:49 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:49 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:49 user devstack@n-api.service[72596]: X-User-Id: 4ef040bbdf0346b98a7816a6d0b02cdf Apr 20 05:34:49 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-760805304-project-member Apr 20 05:34:49 user devstack@n-api.service[72596]: method: > Apr 20 05:34:49 user devstack@n-api.service[72596]: exception: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:49 user devstack@n-api.service[72596]: action_args: {'id': '5840d3e8-bf88-40d9-a864-03fb8c090e1a'} Apr 20 05:34:49 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. Apr 20 05:34:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] Returning 404 to user: Instance 5840d3e8-bf88-40d9-a864-03fb8c090e1a could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:49 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-7832106e-1f44-420f-ab2b-2bfba7bd7536 tempest-AttachVolumeShelveTestJSON-760805304 tempest-AttachVolumeShelveTestJSON-760805304-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a" status: 404 len: 111 microversion: 2.20 time: 0.029029 Apr 20 05:34:49 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 104/302] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:34:49 2023] GET /compute/v2.1/servers/5840d3e8-bf88-40d9-a864-03fb8c090e1a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:52 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb937659897494cb185f8f5ce7f8b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43425b2c00284dc48e18d06e1a8e21e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:52 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-aae550c4-142f-440a-a105-145037ae2345 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956" status: 200 len: 1494 microversion: 2.1 time: 0.411415 Apr 20 05:34:52 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 98/303] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:52 2023] GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956 => generated 1494 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:54 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:54 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a8eeb360-568f-4d03-9cb9-0a180da6c603 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 200 len: 1544 microversion: 2.1 time: 0.288386 Apr 20 05:34:54 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 102/304] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:54 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 1544 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: ab7a2c49-e524-4472-82c7-5046bd66d9b3] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:57 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] HTTP exception thrown: Instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 could not be found. Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Request method failure captured: Apr 20 05:34:57 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 HTTP/1.1 Apr 20 05:34:57 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:34:57 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:34:57 user devstack@n-api.service[72596]: Connection: close Apr 20 05:34:57 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:34:57 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:34:57 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:34:57 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:34:57 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM2vuqRiHuccVmuSfhurkQao-DtGIIl5xlrPcebKvkjRk_Oor1j5TeiV7xnPv-BAK3jF4PsICxqSSk8tYk1O7iliDjPUAuJJoEms53i6x23_w_BCamUiply7BM15HLBNwL6GZWiU7a07LVfu4wMWfC2OZM8ct0LrNQH3KgmNEfoXc4I Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Project-Id: b3862eced3a047edbe7a341f7898896b Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1773828817 Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3862eced3a047edbe7a341f7898896b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3862eced3a047edbe7a341f7898896b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3862eced3a047edbe7a341f7898896b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1773828817 Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Tenant-Id: b3862eced3a047edbe7a341f7898896b Apr 20 05:34:57 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1773828817 Apr 20 05:34:57 user devstack@n-api.service[72596]: X-User: tempest-ServerRescueNegativeTestJSON-1773828817-project-member Apr 20 05:34:57 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:34:57 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:34:57 user devstack@n-api.service[72596]: X-User-Id: 4215c58b1fbf42f9ba87364b3b4ec5cd Apr 20 05:34:57 user devstack@n-api.service[72596]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1773828817-project-member Apr 20 05:34:57 user devstack@n-api.service[72596]: method: > Apr 20 05:34:57 user devstack@n-api.service[72596]: exception: Instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 could not be found. Apr 20 05:34:57 user devstack@n-api.service[72596]: action_args: {'id': 'ab7a2c49-e524-4472-82c7-5046bd66d9b3'} Apr 20 05:34:57 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 could not be found. Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 could not be found. Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 could not be found. Apr 20 05:34:57 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:34:57 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Returning 404 to user: Instance ab7a2c49-e524-4472-82c7-5046bd66d9b3 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:34:57 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-be30928d-af17-4b2d-9495-ea49ec747232 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3" status: 404 len: 111 microversion: 2.1 time: 0.259590 Apr 20 05:34:57 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 105/305] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:57 2023] GET /compute/v2.1/servers/ab7a2c49-e524-4472-82c7-5046bd66d9b3 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:57 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:34:57 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-5520c3ea-b0cf-4068-857f-bb7061b783d3 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266" status: 204 len: 0 microversion: 2.1 time: 0.119168 Apr 20 05:34:57 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 99/306] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:34:57 2023] DELETE /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:58 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-fb7d0dae-e7b6-4220-829f-1abaf3b61e43 req-614699a0-6d86-404b-849b-915d2376a285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266", "name": "network-vif-unplugged", "status": "completed", "tag": "68089a37-5a59-462b-ab14-1fd2bc4d6eb4"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-fb7d0dae-e7b6-4220-829f-1abaf3b61e43 req-614699a0-6d86-404b-849b-915d2376a285 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-fb7d0dae-e7b6-4220-829f-1abaf3b61e43 req-614699a0-6d86-404b-849b-915d2376a285 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-fb7d0dae-e7b6-4220-829f-1abaf3b61e43 req-614699a0-6d86-404b-849b-915d2376a285 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:58 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4215c58b1fbf42f9ba87364b3b4ec5cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3862eced3a047edbe7a341f7898896b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:34:58 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-fb7d0dae-e7b6-4220-829f-1abaf3b61e43 req-614699a0-6d86-404b-849b-915d2376a285 service nova] Creating event network-vif-unplugged:68089a37-5a59-462b-ab14-1fd2bc4d6eb4 for instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 on user Apr 20 05:34:58 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-fb7d0dae-e7b6-4220-829f-1abaf3b61e43 req-614699a0-6d86-404b-849b-915d2376a285 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029822 Apr 20 05:34:58 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 106/307] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:34:58 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5404e695-f694-441f-9355-de1c325c26f4 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266" status: 200 len: 1508 microversion: 2.1 time: 0.377638 Apr 20 05:34:58 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 103/308] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:34:57 2023] GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 => generated 1508 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:34:59 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-9eed6ec4-95af-4528-958b-988180a769ad req-61ba928b-850d-4fc0-8e66-4b23b21c5d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266", "name": "network-vif-deleted", "tag": "68089a37-5a59-462b-ab14-1fd2bc4d6eb4"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:34:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9eed6ec4-95af-4528-958b-988180a769ad req-61ba928b-850d-4fc0-8e66-4b23b21c5d4d service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:34:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9eed6ec4-95af-4528-958b-988180a769ad req-61ba928b-850d-4fc0-8e66-4b23b21c5d4d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:34:59 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-9eed6ec4-95af-4528-958b-988180a769ad req-61ba928b-850d-4fc0-8e66-4b23b21c5d4d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:34:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-9eed6ec4-95af-4528-958b-988180a769ad req-61ba928b-850d-4fc0-8e66-4b23b21c5d4d service nova] Creating event network-vif-deleted:68089a37-5a59-462b-ab14-1fd2bc4d6eb4 for instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 on user Apr 20 05:34:59 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-9eed6ec4-95af-4528-958b-988180a769ad req-61ba928b-850d-4fc0-8e66-4b23b21c5d4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Apr 20 05:34:59 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 100/309] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-1dc274a1-c734-4a7f-80c8-310501cd2794 req-cf932d4c-5e2d-42ec-819b-1378dc1a374f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266", "name": "network-vif-plugged", "status": "completed", "tag": "68089a37-5a59-462b-ab14-1fd2bc4d6eb4"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-1dc274a1-c734-4a7f-80c8-310501cd2794 req-cf932d4c-5e2d-42ec-819b-1378dc1a374f service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-1dc274a1-c734-4a7f-80c8-310501cd2794 req-cf932d4c-5e2d-42ec-819b-1378dc1a374f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-1dc274a1-c734-4a7f-80c8-310501cd2794 req-cf932d4c-5e2d-42ec-819b-1378dc1a374f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-1dc274a1-c734-4a7f-80c8-310501cd2794 req-cf932d4c-5e2d-42ec-819b-1378dc1a374f service nova] Creating event network-vif-plugged:68089a37-5a59-462b-ab14-1fd2bc4d6eb4 for instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 on user Apr 20 05:35:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-1dc274a1-c734-4a7f-80c8-310501cd2794 req-cf932d4c-5e2d-42ec-819b-1378dc1a374f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036398 Apr 20 05:35:00 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 107/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:03 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:03 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-9a422164-4838-4e57-ba7b-0bfec34f02c0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1493 microversion: 2.1 time: 0.259177 Apr 20 05:35:03 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 104/311] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:03 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1493 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:15 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:15 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-989e19f3-e9f2-449b-9076-2f548b6a25c3 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.267393 Apr 20 05:35:15 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 101/312] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:15 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=10 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=10 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:15 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:15 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-4ebbd029-9602-4bb4-b831-379adefcf89a tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.188813 Apr 20 05:35:15 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 108/313] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:15 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=20 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:15 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:16 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:16 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-9ccf5ef1-3883-43a1-8650-c7f42d62f6cf tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.232034 Apr 20 05:35:16 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:15 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:35:17 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-455475100", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "8d345021-146e-473e-8740-41c1850cd33e", "destination_type": "volume"}], "networks": [{"uuid": "e0617596-5631-4c4b-8dd3-14d66bf18124"}]}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] validate_networks() for [('e0617596-5631-4c4b-8dd3-14d66bf18124', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Getting quotas for user 82ae116ab3d844afa141c1186f2f63d9 and project 29f76ebb01544478b555aff667debbd3. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:35:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:35:18 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-62757048-3d4e-4935-bb15-84f928f57bec tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.866116 Apr 20 05:35:18 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 102/315] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 05:35:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 868 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 05:35:18 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c110ac94-84be-47ca-a1f7-56e4f3dfa520 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c110ac94-84be-47ca-a1f7-56e4f3dfa520 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:18 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-c110ac94-84be-47ca-a1f7-56e4f3dfa520 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:18 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-c110ac94-84be-47ca-a1f7-56e4f3dfa520 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:18 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-c110ac94-84be-47ca-a1f7-56e4f3dfa520 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:18 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-c110ac94-84be-47ca-a1f7-56e4f3dfa520 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203" status: 200 len: 1394 microversion: 2.87 time: 0.068578 Apr 20 05:35:18 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 109/316] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:35:18 2023] GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203 => generated 1394 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 20 05:35:23 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-6d6e74e8-1ab4-49b0-a653-509ef5215171 req-189dcd2e-440a-4c98-88d0-9c99e5f8e723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34028424-361c-4f84-bf1d-d9e95655f203", "tag": "70106c86-49a8-4c4f-a775-57b96855703d"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6d6e74e8-1ab4-49b0-a653-509ef5215171 req-189dcd2e-440a-4c98-88d0-9c99e5f8e723 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6d6e74e8-1ab4-49b0-a653-509ef5215171 req-189dcd2e-440a-4c98-88d0-9c99e5f8e723 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:23 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6d6e74e8-1ab4-49b0-a653-509ef5215171 req-189dcd2e-440a-4c98-88d0-9c99e5f8e723 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-6d6e74e8-1ab4-49b0-a653-509ef5215171 req-189dcd2e-440a-4c98-88d0-9c99e5f8e723 service nova] Creating event network-changed:70106c86-49a8-4c4f-a775-57b96855703d for instance 34028424-361c-4f84-bf1d-d9e95655f203 on user Apr 20 05:35:23 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-6d6e74e8-1ab4-49b0-a653-509ef5215171 req-189dcd2e-440a-4c98-88d0-9c99e5f8e723 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034991 Apr 20 05:35:23 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:24 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-fb4e9980-2111-499c-abb2-de269c9d2f8a tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Action: 'create', calling method: .version_select at 0x7ff3029a5870>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-505941647", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBwXGxFjj5vzBwR1qo2XsLGRQo2W/4R8RkL01uUjTOagSGArPqq6/t9g8e1pYDKlmogoRf9FT6sJNlBfS+zJ0zPMgBywHOlPfyPFKWpg00XELop4nWp2BUpyXgmiLNR5DQ=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:24 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-fb4e9980-2111-499c-abb2-de269c9d2f8a tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:35:24 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-fb4e9980-2111-499c-abb2-de269c9d2f8a tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for user 151ab31d22b943519eb10b95b8542cc5 and project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:35:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-fb4e9980-2111-499c-abb2-de269c9d2f8a tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046705 Apr 20 05:35:24 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 103/318] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:35:24 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:24 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1736981550", "imageRef": "3f036090-7f12-45eb-bc09-9ba3d93fda79", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-505941647", "networks": [{"uuid": "6808a39f-22cd-436a-8bc9-834a064db94c"}]}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:24 user devstack@n-api.service[72596]: DEBUG nova.network.neutron [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] validate_networks() for [('6808a39f-22cd-436a-8bc9-834a064db94c', None, None, None, None, None)] {{(pid=72596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:35:24 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-1c74d254-510f-44ec-82b3-e5ce1b99adf9 req-376101b4-79e6-47c5-b5ed-bae3d590ad4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34028424-361c-4f84-bf1d-d9e95655f203", "name": "network-vif-deleted", "tag": "70106c86-49a8-4c4f-a775-57b96855703d"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-1c74d254-510f-44ec-82b3-e5ce1b99adf9 req-376101b4-79e6-47c5-b5ed-bae3d590ad4b service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-1c74d254-510f-44ec-82b3-e5ce1b99adf9 req-376101b4-79e6-47c5-b5ed-bae3d590ad4b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:24 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-1c74d254-510f-44ec-82b3-e5ce1b99adf9 req-376101b4-79e6-47c5-b5ed-bae3d590ad4b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:24 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.compute.server_external_events [req-1c74d254-510f-44ec-82b3-e5ce1b99adf9 req-376101b4-79e6-47c5-b5ed-bae3d590ad4b service nova] Unable to find a host for instance 34028424-361c-4f84-bf1d-d9e95655f203. Dropping event network-vif-deleted {{(pid=72597) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 05:35:24 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-1c74d254-510f-44ec-82b3-e5ce1b99adf9 req-376101b4-79e6-47c5-b5ed-bae3d590ad4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.025692 Apr 20 05:35:24 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 107/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:24 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Flavor limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Image limits 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Flavor pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Image pref 0:0:0 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.virt.hardware [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for user 151ab31d22b943519eb10b95b8542cc5 and project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'cores', 'ram', 'instances'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Going to run 1 instances... {{(pid=72596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:35:25 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3f036090-7f12-45eb-bc09-9ba3d93fda79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:35:25 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-acfd4756-a3de-40dd-ba18-d7223cc53102 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.817899 Apr 20 05:35:25 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 110/320] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:35:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:35:25 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-cd60073a-2c9c-4dde-97a9-02ec07bb76d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:25 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-cd60073a-2c9c-4dde-97a9-02ec07bb76d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:25 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-cd60073a-2c9c-4dde-97a9-02ec07bb76d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:25 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-cd60073a-2c9c-4dde-97a9-02ec07bb76d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 200 len: 1252 microversion: 2.1 time: 0.090462 Apr 20 05:35:25 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 104/321] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:25 2023] GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 1252 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:35:27 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-6fd35796-2648-408d-b59f-52dd501edb7a req-04e84bbf-5636-4ba3-8405-ce4169c71834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a420a0f-1dba-4fdc-937f-3a77bccfeb2a", "tag": "b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6fd35796-2648-408d-b59f-52dd501edb7a req-04e84bbf-5636-4ba3-8405-ce4169c71834 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6fd35796-2648-408d-b59f-52dd501edb7a req-04e84bbf-5636-4ba3-8405-ce4169c71834 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:27 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-6fd35796-2648-408d-b59f-52dd501edb7a req-04e84bbf-5636-4ba3-8405-ce4169c71834 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:27 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-6fd35796-2648-408d-b59f-52dd501edb7a req-04e84bbf-5636-4ba3-8405-ce4169c71834 service nova] Creating event network-changed:b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3 for instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a on user Apr 20 05:35:27 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-6fd35796-2648-408d-b59f-52dd501edb7a req-04e84bbf-5636-4ba3-8405-ce4169c71834 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030142 Apr 20 05:35:27 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 108/322] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:29 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-08869d5a-23ea-4754-af64-ca9e75b468d6 req-cc4aa327-2b42-44bb-aec9-e28357c56ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a420a0f-1dba-4fdc-937f-3a77bccfeb2a", "name": "network-vif-plugged", "status": "completed", "tag": "b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:29 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-08869d5a-23ea-4754-af64-ca9e75b468d6 req-cc4aa327-2b42-44bb-aec9-e28357c56ca4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:29 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-08869d5a-23ea-4754-af64-ca9e75b468d6 req-cc4aa327-2b42-44bb-aec9-e28357c56ca4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:29 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-08869d5a-23ea-4754-af64-ca9e75b468d6 req-cc4aa327-2b42-44bb-aec9-e28357c56ca4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:29 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-08869d5a-23ea-4754-af64-ca9e75b468d6 req-cc4aa327-2b42-44bb-aec9-e28357c56ca4 service nova] Creating event network-vif-plugged:b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3 for instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a on user Apr 20 05:35:29 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-08869d5a-23ea-4754-af64-ca9e75b468d6 req-cc4aa327-2b42-44bb-aec9-e28357c56ca4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037080 Apr 20 05:35:29 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 111/323] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:31 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-ad0aae1b-2b7c-4871-93c6-0730c3f8a3dd req-cc2e07e6-0ddd-45cd-86cc-9bc9eb0bad5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a420a0f-1dba-4fdc-937f-3a77bccfeb2a", "name": "network-vif-plugged", "status": "completed", "tag": "b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:31 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:31 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=8 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:31 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-ad0aae1b-2b7c-4871-93c6-0730c3f8a3dd req-cc2e07e6-0ddd-45cd-86cc-9bc9eb0bad5f service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:31 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-ad0aae1b-2b7c-4871-93c6-0730c3f8a3dd req-cc2e07e6-0ddd-45cd-86cc-9bc9eb0bad5f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:31 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-ad0aae1b-2b7c-4871-93c6-0730c3f8a3dd req-cc2e07e6-0ddd-45cd-86cc-9bc9eb0bad5f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:31 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-ad0aae1b-2b7c-4871-93c6-0730c3f8a3dd req-cc2e07e6-0ddd-45cd-86cc-9bc9eb0bad5f service nova] Creating event network-vif-plugged:b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3 for instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a on user Apr 20 05:35:32 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-ad0aae1b-2b7c-4871-93c6-0730c3f8a3dd req-cc2e07e6-0ddd-45cd-86cc-9bc9eb0bad5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050676 Apr 20 05:35:32 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 105/324] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=8 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=12 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] [instance: be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:48 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] HTTP exception thrown: Instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 could not be found. Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Request method failure captured: Apr 20 05:35:48 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 HTTP/1.1 Apr 20 05:35:48 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:35:48 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:35:48 user devstack@n-api.service[72597]: Connection: close Apr 20 05:35:48 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:35:48 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:35:48 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:35:48 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:35:48 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM2vuqRiHuccVmuSfhurkQao-DtGIIl5xlrPcebKvkjRk_Oor1j5TeiV7xnPv-BAK3jF4PsICxqSSk8tYk1O7iliDjPUAuJJoEms53i6x23_w_BCamUiply7BM15HLBNwL6GZWiU7a07LVfu4wMWfC2OZM8ct0LrNQH3KgmNEfoXc4I Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Project-Id: b3862eced3a047edbe7a341f7898896b Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1773828817 Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3862eced3a047edbe7a341f7898896b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b3862eced3a047edbe7a341f7898896b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b3862eced3a047edbe7a341f7898896b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1773828817 Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Tenant-Id: b3862eced3a047edbe7a341f7898896b Apr 20 05:35:48 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1773828817 Apr 20 05:35:48 user devstack@n-api.service[72597]: X-User: tempest-ServerRescueNegativeTestJSON-1773828817-project-member Apr 20 05:35:48 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:35:48 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:35:48 user devstack@n-api.service[72597]: X-User-Id: 4215c58b1fbf42f9ba87364b3b4ec5cd Apr 20 05:35:48 user devstack@n-api.service[72597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1773828817-project-member Apr 20 05:35:48 user devstack@n-api.service[72597]: method: > Apr 20 05:35:48 user devstack@n-api.service[72597]: exception: Instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 could not be found. Apr 20 05:35:48 user devstack@n-api.service[72597]: action_args: {'id': 'be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266'} Apr 20 05:35:48 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 could not be found. Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 could not be found. Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 could not be found. Apr 20 05:35:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:35:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] Returning 404 to user: Instance be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:35:48 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a3803c34-eb32-434d-bffd-f3b20cc56027 tempest-ServerRescueNegativeTestJSON-1773828817 tempest-ServerRescueNegativeTestJSON-1773828817-project-member] 10.0.0.210 "GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266" status: 404 len: 111 microversion: 2.1 time: 0.040238 Apr 20 05:35:48 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 109/325] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:48 2023] GET /compute/v2.1/servers/be7c7e85-26ff-4f1c-aa23-0bb1ce8bc266 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=8 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=10 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:35:54 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-519319ee-9355-4e84-93df-0c617c31cf71 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956" status: 204 len: 0 microversion: 2.1 time: 0.123054 Apr 20 05:35:54 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 112/326] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:35:54 2023] DELETE /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=12 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=4 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:54 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-fe97c62b-ba95-4e36-a672-482aafa98987 req-2703c5a8-adb0-4727-b9f8-85866ccbbecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-fe97c62b-ba95-4e36-a672-482aafa98987 req-2703c5a8-adb0-4727-b9f8-85866ccbbecd service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-fe97c62b-ba95-4e36-a672-482aafa98987 req-2703c5a8-adb0-4727-b9f8-85866ccbbecd service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-fe97c62b-ba95-4e36-a672-482aafa98987 req-2703c5a8-adb0-4727-b9f8-85866ccbbecd service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:54 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-fe97c62b-ba95-4e36-a672-482aafa98987 req-2703c5a8-adb0-4727-b9f8-85866ccbbecd service nova] Creating event network-vif-unplugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:35:54 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-fe97c62b-ba95-4e36-a672-482aafa98987 req-2703c5a8-adb0-4727-b9f8-85866ccbbecd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031062 Apr 20 05:35:54 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 110/327] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:54 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb937659897494cb185f8f5ce7f8b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43425b2c00284dc48e18d06e1a8e21e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:54 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-576420ba-ace1-4a55-aefc-b6a2a5d72131 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956" status: 200 len: 1500 microversion: 2.1 time: 0.323599 Apr 20 05:35:54 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 106/328] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:54 2023] GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956 => generated 1500 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:54 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:55 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-b340d3ac-86f8-4797-9ffa-637ff5013faa tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.218112 Apr 20 05:35:55 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 113/329] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:35:54 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81/os-interface => generated 283 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:56 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-9e457a6b-4a99-4920-ac84-777cd73cbf94 req-ee351a96-7480-484a-b594-8ed736535f61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9e457a6b-4a99-4920-ac84-777cd73cbf94 req-ee351a96-7480-484a-b594-8ed736535f61 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9e457a6b-4a99-4920-ac84-777cd73cbf94 req-ee351a96-7480-484a-b594-8ed736535f61 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-9e457a6b-4a99-4920-ac84-777cd73cbf94 req-ee351a96-7480-484a-b594-8ed736535f61 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:56 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-9e457a6b-4a99-4920-ac84-777cd73cbf94 req-ee351a96-7480-484a-b594-8ed736535f61 service nova] Creating event network-changed:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:35:56 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-9e457a6b-4a99-4920-ac84-777cd73cbf94 req-ee351a96-7480-484a-b594-8ed736535f61 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032813 Apr 20 05:35:56 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 111/330] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:56 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:56 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d0183cd0-d4a0-4c69-8985-2f1b258f91f1 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81/ips" status: 200 len: 109 microversion: 2.1 time: 0.040295 Apr 20 05:35:56 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 107/331] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 05:35:56 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81/ips => generated 109 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:56 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-plugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}, {"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-plugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}, {"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-plugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}, {"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-plugged", "status": "completed", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}, {"server_uuid": "f86221f9-7412-485d-b7c8-d8f159d8c956", "name": "network-vif-deleted", "tag": "4c2ca3b5-5453-4631-9833-d3d92985c180"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Creating event network-vif-plugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:35:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Creating event network-vif-plugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:35:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Creating event network-vif-plugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:35:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Creating event network-vif-plugged:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:35:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] Creating event network-vif-deleted:4c2ca3b5-5453-4631-9833-d3d92985c180 for instance f86221f9-7412-485d-b7c8-d8f159d8c956 on user Apr 20 05:35:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-710b5859-32b4-411f-8090-aa8819c9714f req-3d5333f0-6546-4442-a89d-30e8cdd23f41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.031446 Apr 20 05:35:56 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 114/332] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:56 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:57 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:35:57 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-70673b2a-2747-44ec-9187-9693e63436b8 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 204 len: 0 microversion: 2.1 time: 0.121003 Apr 20 05:35:57 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:35:57 2023] DELETE /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:57 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1558ef8ec15f4bcaa4d8a73bf3b457bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1069c90da8244529aca2b5907e46691', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:35:57 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-cdedbb7f-6f04-4d37-a2db-bff61867c2f2 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 200 len: 1667 microversion: 2.1 time: 0.183091 Apr 20 05:35:57 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 108/334] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:35:57 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 1667 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 05:35:58 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "name": "network-vif-unplugged", "status": "completed", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}, {"server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "name": "network-vif-plugged", "status": "completed", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:35:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:35:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:35:58 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:35:58 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] Creating event network-vif-unplugged:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:35:58 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] Creating event network-vif-plugged:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:35:58 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-cbe3daf2-274a-496f-8fa4-cb12842dc2ae req-b0ed7238-1e24-4838-80bb-bc8a86957b0d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028156 Apr 20 05:35:58 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 115/335] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:35:58 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:00 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-baf5a212-1358-41cf-aed8-816fafcf3266 req-c3a7f086-d740-45a3-a262-d59d56025bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81", "name": "network-vif-deleted", "tag": "27aa88e0-680c-47b6-85bc-0a31ca2a1c2b"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-baf5a212-1358-41cf-aed8-816fafcf3266 req-c3a7f086-d740-45a3-a262-d59d56025bed service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-baf5a212-1358-41cf-aed8-816fafcf3266 req-c3a7f086-d740-45a3-a262-d59d56025bed service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-baf5a212-1358-41cf-aed8-816fafcf3266 req-c3a7f086-d740-45a3-a262-d59d56025bed service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:00 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-baf5a212-1358-41cf-aed8-816fafcf3266 req-c3a7f086-d740-45a3-a262-d59d56025bed service nova] Creating event network-vif-deleted:27aa88e0-680c-47b6-85bc-0a31ca2a1c2b for instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 on user Apr 20 05:36:00 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-baf5a212-1358-41cf-aed8-816fafcf3266 req-c3a7f086-d740-45a3-a262-d59d56025bed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032104 Apr 20 05:36:00 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 113/336] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:04 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:05 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:05 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-86b1d427-6c4e-4fc5-a437-da15ba8a2e32 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1493 microversion: 2.1 time: 0.315740 Apr 20 05:36:05 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 109/337] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:04 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1493 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG nova.objects.instance [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lazy-loading 'fault' on Instance uuid 34028424-361c-4f84-bf1d-d9e95655f203 {{(pid=72596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:09 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-7bdeb5d2-d9e2-4a57-8085-c814710f2a3b tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203" status: 200 len: 1649 microversion: 2.87 time: 0.141516 Apr 20 05:36:09 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 116/338] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:36:08 2023] GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203 => generated 1649 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Doing local delete in cell ae6ab1ab-1140-4b4c-bf55-c15161615bab(cell1) {{(pid=72597) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72597]: WARNING nova.compute.api [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] instance's host None is down, deleting from database Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] deallocate_for_instance() {{(pid=72597) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Instance cache missing network info. {{(pid=72597) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Updating instance_info_cache with network_info: [] {{(pid=72597) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 05:36:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=72597) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 05:36:09 user devstack@n-api.service[72597]: WARNING nova.compute.api [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 05:36:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-5fde801c-3c3d-439f-84e8-ddb416192445 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203" status: 204 len: 0 microversion: 2.87 time: 0.734763 Apr 20 05:36:09 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 114/339] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:36:09 2023] DELETE /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 34028424-361c-4f84-bf1d-d9e95655f203] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] HTTP exception thrown: Instance 34028424-361c-4f84-bf1d-d9e95655f203 could not be found. Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Request method failure captured: Apr 20 05:36:09 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203 HTTP/1.1 Apr 20 05:36:09 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:36:09 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:36:09 user devstack@n-api.service[72598]: Connection: close Apr 20 05:36:09 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:36:09 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:36:09 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:36:09 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:36:09 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM165r8zqHmCsou-O3eC_SwFetKJgys3yS1vQYllHFUXXnq9-EgvLvGsJcBGYTecRpSUKpPFpGdASpgUr4a-KiCWYUHe84gKGFMc0idZCUgfZMdRLlQ_hyYS3Mq1STskHbDHrSvBQZNzKToOoS2iTAq87t39n5RGtQmfth8nF-5eKM0 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Project-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29f76ebb01544478b555aff667debbd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Tenant-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:36:09 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:36:09 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:36:09 user devstack@n-api.service[72598]: X-User-Id: 82ae116ab3d844afa141c1186f2f63d9 Apr 20 05:36:09 user devstack@n-api.service[72598]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:36:09 user devstack@n-api.service[72598]: method: > Apr 20 05:36:09 user devstack@n-api.service[72598]: exception: Instance 34028424-361c-4f84-bf1d-d9e95655f203 could not be found. Apr 20 05:36:09 user devstack@n-api.service[72598]: action_args: {'id': '34028424-361c-4f84-bf1d-d9e95655f203'} Apr 20 05:36:09 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34028424-361c-4f84-bf1d-d9e95655f203 could not be found. Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34028424-361c-4f84-bf1d-d9e95655f203 could not be found. Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34028424-361c-4f84-bf1d-d9e95655f203 could not be found. Apr 20 05:36:09 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Returning 404 to user: Instance 34028424-361c-4f84-bf1d-d9e95655f203 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:09 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-3e7169b2-3d48-45a3-a35b-a24059afcbcf tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203" status: 404 len: 111 microversion: 2.87 time: 0.038469 Apr 20 05:36:09 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 110/340] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:36:09 2023] GET /compute/v2.1/servers/34028424-361c-4f84-bf1d-d9e95655f203 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:10 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:36:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-d31c2b58-dafd-4781-88a7-ae0008ba68ee tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084" status: 204 len: 0 microversion: 2.87 time: 0.109544 Apr 20 05:36:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 117/341] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:36:10 2023] DELETE /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:10 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:10 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-bad54237-9858-4a36-9317-81f2a767639d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084" status: 200 len: 1695 microversion: 2.87 time: 0.281406 Apr 20 05:36:10 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 115/342] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:36:10 2023] GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 => generated 1695 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:36:10 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-693e92d4-dff6-4bf0-85f7-23305368ad2c req-05c85bac-4ac8-4214-800b-4799f481e493 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aac33d-2148-4155-b25f-4eeef975c084", "name": "network-vif-unplugged", "status": "completed", "tag": "b5a45572-7f39-418e-9dd3-2231042b048e"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-693e92d4-dff6-4bf0-85f7-23305368ad2c req-05c85bac-4ac8-4214-800b-4799f481e493 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-693e92d4-dff6-4bf0-85f7-23305368ad2c req-05c85bac-4ac8-4214-800b-4799f481e493 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:10 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-693e92d4-dff6-4bf0-85f7-23305368ad2c req-05c85bac-4ac8-4214-800b-4799f481e493 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-693e92d4-dff6-4bf0-85f7-23305368ad2c req-05c85bac-4ac8-4214-800b-4799f481e493 service nova] Creating event network-vif-unplugged:b5a45572-7f39-418e-9dd3-2231042b048e for instance 47aac33d-2148-4155-b25f-4eeef975c084 on user Apr 20 05:36:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-693e92d4-dff6-4bf0-85f7-23305368ad2c req-05c85bac-4ac8-4214-800b-4799f481e493 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032923 Apr 20 05:36:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 111/343] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:11 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-6c8dd891-231c-43f5-895e-26b92982eaf4 req-96547b35-b8e5-4539-bc66-b28098785e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aac33d-2148-4155-b25f-4eeef975c084", "name": "network-vif-deleted", "tag": "b5a45572-7f39-418e-9dd3-2231042b048e"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-6c8dd891-231c-43f5-895e-26b92982eaf4 req-96547b35-b8e5-4539-bc66-b28098785e56 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-6c8dd891-231c-43f5-895e-26b92982eaf4 req-96547b35-b8e5-4539-bc66-b28098785e56 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:11 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-6c8dd891-231c-43f5-895e-26b92982eaf4 req-96547b35-b8e5-4539-bc66-b28098785e56 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-6c8dd891-231c-43f5-895e-26b92982eaf4 req-96547b35-b8e5-4539-bc66-b28098785e56 service nova] Creating event network-vif-deleted:b5a45572-7f39-418e-9dd3-2231042b048e for instance 47aac33d-2148-4155-b25f-4eeef975c084 on user Apr 20 05:36:11 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-6c8dd891-231c-43f5-895e-26b92982eaf4 req-96547b35-b8e5-4539-bc66-b28098785e56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031811 Apr 20 05:36:11 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 118/344] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-ed102f1e-b660-47b5-b349-362de1dbd0fb req-ee8d4608-08bd-4204-9a30-47c6a0b77fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47aac33d-2148-4155-b25f-4eeef975c084", "name": "network-vif-plugged", "status": "completed", "tag": "b5a45572-7f39-418e-9dd3-2231042b048e"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-ed102f1e-b660-47b5-b349-362de1dbd0fb req-ee8d4608-08bd-4204-9a30-47c6a0b77fb4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-ed102f1e-b660-47b5-b349-362de1dbd0fb req-ee8d4608-08bd-4204-9a30-47c6a0b77fb4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-ed102f1e-b660-47b5-b349-362de1dbd0fb req-ee8d4608-08bd-4204-9a30-47c6a0b77fb4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-ed102f1e-b660-47b5-b349-362de1dbd0fb req-ee8d4608-08bd-4204-9a30-47c6a0b77fb4 service nova] Creating event network-vif-plugged:b5a45572-7f39-418e-9dd3-2231042b048e for instance 47aac33d-2148-4155-b25f-4eeef975c084 on user Apr 20 05:36:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-ed102f1e-b660-47b5-b349-362de1dbd0fb req-ee8d4608-08bd-4204-9a30-47c6a0b77fb4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029227 Apr 20 05:36:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:15 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:15 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-6f6378a2-c4e5-4945-a8f0-d9403957a04d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 200 len: 1537 microversion: 2.1 time: 0.270725 Apr 20 05:36:15 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 112/346] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:15 2023] GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 1537 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:18 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:18 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-0b982abe-5978-493f-af19-4ed6f66a92a2 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1658 microversion: 2.1 time: 0.551208 Apr 20 05:36:18 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 119/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:18 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1658 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=19,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: f86221f9-7412-485d-b7c8-d8f159d8c956] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:44 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] HTTP exception thrown: Instance f86221f9-7412-485d-b7c8-d8f159d8c956 could not be found. Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Request method failure captured: Apr 20 05:36:44 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956 HTTP/1.1 Apr 20 05:36:44 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:36:44 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:36:44 user devstack@n-api.service[72597]: Connection: close Apr 20 05:36:44 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:36:44 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:36:44 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:36:44 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:36:44 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM5N88SZIhueFE44VVtmDeyEefn34__CNhVZRd-ygUhicOeojVWULmfVCFGbej5oqx4nk0vv7RuF3g9UHLsZ8CVLQMPHeA4_15y3QQIh6GCJABaejdsV2A0iIaaI1BIfis7ObxCUDsVFnS0TvpPq3LWYMcJCkDK20i8AeseyOe2sQ3U Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Project-Id: 43425b2c00284dc48e18d06e1a8e21e5 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Project-Name: tempest-VolumesAdminNegativeTest-849033716 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/43425b2c00284dc48e18d06e1a8e21e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/43425b2c00284dc48e18d06e1a8e21e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/43425b2c00284dc48e18d06e1a8e21e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Tenant: tempest-VolumesAdminNegativeTest-849033716 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Tenant-Id: 43425b2c00284dc48e18d06e1a8e21e5 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-849033716 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-User: tempest-VolumesAdminNegativeTest-849033716-project-member Apr 20 05:36:44 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:36:44 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:36:44 user devstack@n-api.service[72597]: X-User-Id: 4eb937659897494cb185f8f5ce7f8b22 Apr 20 05:36:44 user devstack@n-api.service[72597]: X-User-Name: tempest-VolumesAdminNegativeTest-849033716-project-member Apr 20 05:36:44 user devstack@n-api.service[72597]: method: > Apr 20 05:36:44 user devstack@n-api.service[72597]: exception: Instance f86221f9-7412-485d-b7c8-d8f159d8c956 could not be found. Apr 20 05:36:44 user devstack@n-api.service[72597]: action_args: {'id': 'f86221f9-7412-485d-b7c8-d8f159d8c956'} Apr 20 05:36:44 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f86221f9-7412-485d-b7c8-d8f159d8c956 could not be found. Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f86221f9-7412-485d-b7c8-d8f159d8c956 could not be found. Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f86221f9-7412-485d-b7c8-d8f159d8c956 could not be found. Apr 20 05:36:44 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:44 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Returning 404 to user: Instance f86221f9-7412-485d-b7c8-d8f159d8c956 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:44 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-3e8a453d-130c-499f-841d-d13a8b64b395 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956" status: 404 len: 111 microversion: 2.1 time: 0.085210 Apr 20 05:36:44 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 117/348] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:44 2023] GET /compute/v2.1/servers/f86221f9-7412-485d-b7c8-d8f159d8c956 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=14 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=32 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:44 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:36:45 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-9bb81328-fa37-46d0-8c4d-96f7d1a9cff8 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf" status: 204 len: 0 microversion: 2.1 time: 0.146105 Apr 20 05:36:45 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 113/349] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:36:44 2023] DELETE /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:45 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4eb937659897494cb185f8f5ce7f8b22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43425b2c00284dc48e18d06e1a8e21e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:36:45 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-afd90f32-98e3-472f-8d1d-e84d052b15bf tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf" status: 200 len: 1668 microversion: 2.1 time: 0.334002 Apr 20 05:36:45 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 120/350] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:45 2023] GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf => generated 1668 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:36:45 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-99af6e1e-dd17-4175-8467-dd373a84ac85 req-2073d77d-a6a6-4853-b2bf-185a6a7c4e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "name": "network-vif-unplugged", "status": "completed", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:45 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-99af6e1e-dd17-4175-8467-dd373a84ac85 req-2073d77d-a6a6-4853-b2bf-185a6a7c4e53 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:45 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-99af6e1e-dd17-4175-8467-dd373a84ac85 req-2073d77d-a6a6-4853-b2bf-185a6a7c4e53 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:45 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-99af6e1e-dd17-4175-8467-dd373a84ac85 req-2073d77d-a6a6-4853-b2bf-185a6a7c4e53 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:45 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-99af6e1e-dd17-4175-8467-dd373a84ac85 req-2073d77d-a6a6-4853-b2bf-185a6a7c4e53 service nova] Creating event network-vif-unplugged:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:36:45 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-99af6e1e-dd17-4175-8467-dd373a84ac85 req-2073d77d-a6a6-4853-b2bf-185a6a7c4e53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069321 Apr 20 05:36:45 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 118/351] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:46 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-820b0d6e-65d4-4a0f-8268-247816d942fa req-3661b830-e6f4-48c2-8838-4a34a4019b53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "name": "network-vif-deleted", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:46 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-820b0d6e-65d4-4a0f-8268-247816d942fa req-3661b830-e6f4-48c2-8838-4a34a4019b53 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:46 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-820b0d6e-65d4-4a0f-8268-247816d942fa req-3661b830-e6f4-48c2-8838-4a34a4019b53 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:46 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-820b0d6e-65d4-4a0f-8268-247816d942fa req-3661b830-e6f4-48c2-8838-4a34a4019b53 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:46 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-820b0d6e-65d4-4a0f-8268-247816d942fa req-3661b830-e6f4-48c2-8838-4a34a4019b53 service nova] Creating event network-vif-deleted:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:36:46 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-820b0d6e-65d4-4a0f-8268-247816d942fa req-3661b830-e6f4-48c2-8838-4a34a4019b53 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034197 Apr 20 05:36:46 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 114/352] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:47 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-cd8d1cfb-cbe0-4132-89ce-05ac81cdc2fe req-6a3a35c4-62a5-4467-b88f-39ecab43a74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80626649-9627-4a00-abcb-a307ac8c15bf", "name": "network-vif-plugged", "status": "completed", "tag": "9e7fb6d2-0ab7-4fd8-a650-7a5168722edd"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:36:47 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-cd8d1cfb-cbe0-4132-89ce-05ac81cdc2fe req-6a3a35c4-62a5-4467-b88f-39ecab43a74f service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:47 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-cd8d1cfb-cbe0-4132-89ce-05ac81cdc2fe req-6a3a35c4-62a5-4467-b88f-39ecab43a74f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:47 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-cd8d1cfb-cbe0-4132-89ce-05ac81cdc2fe req-6a3a35c4-62a5-4467-b88f-39ecab43a74f service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:47 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-cd8d1cfb-cbe0-4132-89ce-05ac81cdc2fe req-6a3a35c4-62a5-4467-b88f-39ecab43a74f service nova] Creating event network-vif-plugged:9e7fb6d2-0ab7-4fd8-a650-7a5168722edd for instance 80626649-9627-4a00-abcb-a307ac8c15bf on user Apr 20 05:36:47 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-cd8d1cfb-cbe0-4132-89ce-05ac81cdc2fe req-6a3a35c4-62a5-4467-b88f-39ecab43a74f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028583 Apr 20 05:36:47 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 121/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:36:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:47 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:47 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 HTTP/1.1 Apr 20 05:36:47 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:36:47 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:36:47 user devstack@n-api.service[72597]: Connection: close Apr 20 05:36:47 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:36:47 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:36:47 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:36:47 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:36:47 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:47 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:47 user devstack@n-api.service[72597]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:47 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:36:47 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:36:47 user devstack@n-api.service[72597]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:47 user devstack@n-api.service[72597]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:47 user devstack@n-api.service[72597]: method: > Apr 20 05:36:47 user devstack@n-api.service[72597]: exception: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:47 user devstack@n-api.service[72597]: action_args: {'id': '8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81'} Apr 20 05:36:47 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:47 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:47 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:47 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-284efabb-6cbd-47ef-9154-a27e43781dcc tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 404 len: 111 microversion: 2.1 time: 0.031370 Apr 20 05:36:47 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:47 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:47 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-c0a169a8-5154-45d9-9ae2-638f4582430a tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '.version_select at 0x7ff3029a7370>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:47 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-c0a169a8-5154-45d9-9ae2-638f4582430a tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-66653533" status: 202 len: 0 microversion: 2.1 time: 0.024420 Apr 20 05:36:47 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 115/355] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 05:36:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-66653533 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:48 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:48 user devstack@n-api.service[72596]: request: DELETE /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 HTTP/1.1 Apr 20 05:36:48 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:36:48 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:36:48 user devstack@n-api.service[72596]: Connection: close Apr 20 05:36:48 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:36:48 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:36:48 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:36:48 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:36:48 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:48 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:48 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:48 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:36:48 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:36:48 user devstack@n-api.service[72596]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:48 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:48 user devstack@n-api.service[72596]: method: > Apr 20 05:36:48 user devstack@n-api.service[72596]: exception: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72596]: action_args: {'id': '8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81'} Apr 20 05:36:48 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:48 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-869667aa-a942-4aa1-aadc-a5dab6a196a9 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 404 len: 111 microversion: 2.1 time: 0.035960 Apr 20 05:36:48 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 122/356] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:36:48 2023] DELETE /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:48 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:48 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 HTTP/1.1 Apr 20 05:36:48 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:36:48 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:36:48 user devstack@n-api.service[72597]: Connection: close Apr 20 05:36:48 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:36:48 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:36:48 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:36:48 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:36:48 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:48 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:48 user devstack@n-api.service[72597]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:48 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:36:48 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:36:48 user devstack@n-api.service[72597]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:48 user devstack@n-api.service[72597]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:48 user devstack@n-api.service[72597]: method: > Apr 20 05:36:48 user devstack@n-api.service[72597]: exception: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72597]: action_args: {'id': '8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81'} Apr 20 05:36:48 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. Apr 20 05:36:48 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:48 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance 8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:48 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-c239c783-1ceb-40c4-b160-5c16744bb803 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81" status: 404 len: 111 microversion: 2.1 time: 0.027993 Apr 20 05:36:48 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 120/357] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:48 2023] GET /compute/v2.1/servers/8f1b54fb-3bb4-4e0d-a03e-7b7c3a474b81 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:49 user devstack@n-api.service[72598]: request: DELETE /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 HTTP/1.1 Apr 20 05:36:49 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:36:49 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:36:49 user devstack@n-api.service[72598]: Connection: close Apr 20 05:36:49 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:36:49 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:36:49 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:36:49 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:36:49 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72598]: method: > Apr 20 05:36:49 user devstack@n-api.service[72598]: exception: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: action_args: {'id': 'de429117-a3ee-46ae-ba8d-4d2d6c9e3089'} Apr 20 05:36:49 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:49 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-d8009212-f9fc-49f4-84f9-bb91675bc577 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 404 len: 111 microversion: 2.1 time: 0.030434 Apr 20 05:36:49 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 116/358] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:36:49 2023] DELETE /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: de429117-a3ee-46ae-ba8d-4d2d6c9e3089] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:49 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 HTTP/1.1 Apr 20 05:36:49 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:36:49 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:36:49 user devstack@n-api.service[72596]: Connection: close Apr 20 05:36:49 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:36:49 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:36:49 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:36:49 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:36:49 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72596]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72596]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:49 user devstack@n-api.service[72596]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72596]: method: > Apr 20 05:36:49 user devstack@n-api.service[72596]: exception: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72596]: action_args: {'id': 'de429117-a3ee-46ae-ba8d-4d2d6c9e3089'} Apr 20 05:36:49 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance de429117-a3ee-46ae-ba8d-4d2d6c9e3089 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:49 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-ef49de76-dfda-427e-b65b-30afd1f2f724 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089" status: 404 len: 111 microversion: 2.1 time: 0.034515 Apr 20 05:36:49 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 123/359] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:49 2023] GET /compute/v2.1/servers/de429117-a3ee-46ae-ba8d-4d2d6c9e3089 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:49 user devstack@n-api.service[72597]: request: DELETE /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 HTTP/1.1 Apr 20 05:36:49 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:36:49 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:36:49 user devstack@n-api.service[72597]: Connection: close Apr 20 05:36:49 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:36:49 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:36:49 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:36:49 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:36:49 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72597]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72597]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:49 user devstack@n-api.service[72597]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72597]: method: > Apr 20 05:36:49 user devstack@n-api.service[72597]: exception: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72597]: action_args: {'id': '78d63d1a-6a1d-4691-8560-1ec596d47524'} Apr 20 05:36:49 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:49 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-e055e01d-1380-4910-8a40-89c797bf4c48 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 404 len: 111 microversion: 2.1 time: 0.027016 Apr 20 05:36:49 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 121/360] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:36:49 2023] DELETE /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] [instance: 78d63d1a-6a1d-4691-8560-1ec596d47524] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:36:49 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] HTTP exception thrown: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Request method failure captured: Apr 20 05:36:49 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 HTTP/1.1 Apr 20 05:36:49 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:36:49 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:36:49 user devstack@n-api.service[72598]: Connection: close Apr 20 05:36:49 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:36:49 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:36:49 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:36:49 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:36:49 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM1yYqtXs7RmtwzgNh_HaXPW2b4EYJilyRnXPjlwHRm0mNHpah_kK_Qiu6k7lAfhLyenGArRXihyzRqCIQ-ka1Ly7RUjRW7GYV1ByoKhOcZBjaK_xhE9AuhjqvpxDP-jpguFvGxQS5JDgS_iMROofuSLdHLxVA76ISeMqjfxxsbFUaY Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Project-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c1069c90da8244529aca2b5907e46691"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c1069c90da8244529aca2b5907e46691"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Tenant: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Tenant-Id: c1069c90da8244529aca2b5907e46691 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-528498534 Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Id: 1558ef8ec15f4bcaa4d8a73bf3b457bc Apr 20 05:36:49 user devstack@n-api.service[72598]: X-User-Name: tempest-AttachVolumeNegativeTest-528498534-project-member Apr 20 05:36:49 user devstack@n-api.service[72598]: method: > Apr 20 05:36:49 user devstack@n-api.service[72598]: exception: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: action_args: {'id': '78d63d1a-6a1d-4691-8560-1ec596d47524'} Apr 20 05:36:49 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. Apr 20 05:36:49 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:36:49 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] Returning 404 to user: Instance 78d63d1a-6a1d-4691-8560-1ec596d47524 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:36:49 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-b130f366-6e6a-4abe-b501-4e93aaca4132 tempest-AttachVolumeNegativeTest-528498534 tempest-AttachVolumeNegativeTest-528498534-project-member] 10.0.0.210 "GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524" status: 404 len: 111 microversion: 2.1 time: 0.030029 Apr 20 05:36:49 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 117/361] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:36:49 2023] GET /compute/v2.1/servers/78d63d1a-6a1d-4691-8560-1ec596d47524 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: 47aac33d-2148-4155-b25f-4eeef975c084] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=8 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=12 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] HTTP exception thrown: Instance 47aac33d-2148-4155-b25f-4eeef975c084 could not be found. Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Request method failure captured: Apr 20 05:37:00 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 HTTP/1.1 Apr 20 05:37:00 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:37:00 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:37:00 user devstack@n-api.service[72596]: Connection: close Apr 20 05:37:00 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:37:00 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:37:00 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:37:00 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:37:00 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM165r8zqHmCsou-O3eC_SwFetKJgys3yS1vQYllHFUXXnq9-EgvLvGsJcBGYTecRpSUKpPFpGdASpgUr4a-KiCWYUHe84gKGFMc0idZCUgfZMdRLlQ_hyYS3Mq1STskHbDHrSvBQZNzKToOoS2iTAq87t39n5RGtQmfth8nF-5eKM0 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Project-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29f76ebb01544478b555aff667debbd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Tenant-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:37:00 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:37:00 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:37:00 user devstack@n-api.service[72596]: X-User-Id: 82ae116ab3d844afa141c1186f2f63d9 Apr 20 05:37:00 user devstack@n-api.service[72596]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:37:00 user devstack@n-api.service[72596]: method: > Apr 20 05:37:00 user devstack@n-api.service[72596]: exception: Instance 47aac33d-2148-4155-b25f-4eeef975c084 could not be found. Apr 20 05:37:00 user devstack@n-api.service[72596]: action_args: {'id': '47aac33d-2148-4155-b25f-4eeef975c084'} Apr 20 05:37:00 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47aac33d-2148-4155-b25f-4eeef975c084 could not be found. Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47aac33d-2148-4155-b25f-4eeef975c084 could not be found. Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47aac33d-2148-4155-b25f-4eeef975c084 could not be found. Apr 20 05:37:00 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:37:00 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Returning 404 to user: Instance 47aac33d-2148-4155-b25f-4eeef975c084 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:37:00 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-0c58fd6f-30db-40b1-b8f8-39eab8889de5 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084" status: 404 len: 111 microversion: 2.87 time: 0.040612 Apr 20 05:37:00 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 124/362] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:37:00 2023] GET /compute/v2.1/servers/47aac33d-2148-4155-b25f-4eeef975c084 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=10 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=10 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:00 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:37:01 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-cb4df842-e377-4a25-8d91-b820c44186d8 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41" status: 204 len: 0 microversion: 2.87 time: 0.128494 Apr 20 05:37:01 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 122/363] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 05:37:00 2023] DELETE /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:01 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-f91018fc-4bab-49e1-b7b4-08a03d2ac297 req-191b090f-3878-4fa2-8226-e1e0771f4388 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41", "name": "network-vif-unplugged", "status": "completed", "tag": "38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:01 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-f91018fc-4bab-49e1-b7b4-08a03d2ac297 req-191b090f-3878-4fa2-8226-e1e0771f4388 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:01 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-f91018fc-4bab-49e1-b7b4-08a03d2ac297 req-191b090f-3878-4fa2-8226-e1e0771f4388 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:01 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-f91018fc-4bab-49e1-b7b4-08a03d2ac297 req-191b090f-3878-4fa2-8226-e1e0771f4388 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:01 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-f91018fc-4bab-49e1-b7b4-08a03d2ac297 req-191b090f-3878-4fa2-8226-e1e0771f4388 service nova] Creating event network-vif-unplugged:38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2 for instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 on user Apr 20 05:37:01 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-f91018fc-4bab-49e1-b7b4-08a03d2ac297 req-191b090f-3878-4fa2-8226-e1e0771f4388 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029720 Apr 20 05:37:01 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 125/364] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:01 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82ae116ab3d844afa141c1186f2f63d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f76ebb01544478b555aff667debbd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:01 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-6c9dccbb-42bd-4892-8b06-b6be7a7c167d tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41" status: 200 len: 1696 microversion: 2.87 time: 0.266772 Apr 20 05:37:01 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 118/365] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:37:01 2023] GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 => generated 1696 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 05:37:02 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-0a633013-b069-4de4-817e-6566d737de91 req-47e29d23-020c-4773-a0d9-fd3c2d741cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41", "name": "network-vif-deleted", "tag": "38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-0a633013-b069-4de4-817e-6566d737de91 req-47e29d23-020c-4773-a0d9-fd3c2d741cd9 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-0a633013-b069-4de4-817e-6566d737de91 req-47e29d23-020c-4773-a0d9-fd3c2d741cd9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:02 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-0a633013-b069-4de4-817e-6566d737de91 req-47e29d23-020c-4773-a0d9-fd3c2d741cd9 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:02 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-0a633013-b069-4de4-817e-6566d737de91 req-47e29d23-020c-4773-a0d9-fd3c2d741cd9 service nova] Creating event network-vif-deleted:38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2 for instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 on user Apr 20 05:37:02 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-0a633013-b069-4de4-817e-6566d737de91 req-47e29d23-020c-4773-a0d9-fd3c2d741cd9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028856 Apr 20 05:37:02 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 123/366] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-c8f10940-c7c1-44a6-a977-98d2e1d7e421 req-a9eb5150-c4f5-4073-8f10-165297e5bfe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41", "name": "network-vif-plugged", "status": "completed", "tag": "38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-c8f10940-c7c1-44a6-a977-98d2e1d7e421 req-a9eb5150-c4f5-4073-8f10-165297e5bfe7 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-c8f10940-c7c1-44a6-a977-98d2e1d7e421 req-a9eb5150-c4f5-4073-8f10-165297e5bfe7 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-c8f10940-c7c1-44a6-a977-98d2e1d7e421 req-a9eb5150-c4f5-4073-8f10-165297e5bfe7 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-c8f10940-c7c1-44a6-a977-98d2e1d7e421 req-a9eb5150-c4f5-4073-8f10-165297e5bfe7 service nova] Creating event network-vif-plugged:38d2fbd7-b0e3-4c83-a9c5-593c674b0dc2 for instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 on user Apr 20 05:37:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-c8f10940-c7c1-44a6-a977-98d2e1d7e421 req-a9eb5150-c4f5-4073-8f10-165297e5bfe7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028306 Apr 20 05:37:03 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 126/367] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] HTTP exception thrown: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Request method failure captured: Apr 20 05:37:05 user devstack@n-api.service[72598]: request: DELETE /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 HTTP/1.1 Apr 20 05:37:05 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:37:05 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:37:05 user devstack@n-api.service[72598]: Connection: close Apr 20 05:37:05 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:37:05 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:37:05 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:37:05 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:37:05 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM15L4z_Hah_uMb7Zq2aXeiR27dykOqtPffUAmGsLN-dJUgnyoc7J2CAqW9omj3tM46RzvwUtanaN_KVky7MxxrkbfVMHc-O1qBKTDfr_UBgU_IFmfFqnapJi3hB5qRCflJJ5v7CBbI3PDVDfyyO_WjfGdYorDurh2Rzeax6oOvVp_M Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Project-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Project-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Tenant: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Tenant-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-User: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:37:05 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:37:05 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:37:05 user devstack@n-api.service[72598]: X-User-Id: 198edaee95b0445b8cb018046d790576 Apr 20 05:37:05 user devstack@n-api.service[72598]: X-User-Name: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:37:05 user devstack@n-api.service[72598]: method: > Apr 20 05:37:05 user devstack@n-api.service[72598]: exception: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72598]: action_args: {'id': '0156a5dd-1667-414e-bbaa-1980596b82e5'} Apr 20 05:37:05 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Returning 404 to user: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:37:05 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-c508810f-d636-4678-96ea-37fc672ce2b6 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 404 len: 111 microversion: 2.1 time: 0.031557 Apr 20 05:37:05 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 119/368] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:37:05 2023] DELETE /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 0156a5dd-1667-414e-bbaa-1980596b82e5] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] HTTP exception thrown: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Request method failure captured: Apr 20 05:37:05 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 HTTP/1.1 Apr 20 05:37:05 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:37:05 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:37:05 user devstack@n-api.service[72597]: Connection: close Apr 20 05:37:05 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:37:05 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:37:05 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:37:05 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:37:05 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM15L4z_Hah_uMb7Zq2aXeiR27dykOqtPffUAmGsLN-dJUgnyoc7J2CAqW9omj3tM46RzvwUtanaN_KVky7MxxrkbfVMHc-O1qBKTDfr_UBgU_IFmfFqnapJi3hB5qRCflJJ5v7CBbI3PDVDfyyO_WjfGdYorDurh2Rzeax6oOvVp_M Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Project-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Project-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Tenant: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Tenant-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-User: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:37:05 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:37:05 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:37:05 user devstack@n-api.service[72597]: X-User-Id: 198edaee95b0445b8cb018046d790576 Apr 20 05:37:05 user devstack@n-api.service[72597]: X-User-Name: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:37:05 user devstack@n-api.service[72597]: method: > Apr 20 05:37:05 user devstack@n-api.service[72597]: exception: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72597]: action_args: {'id': '0156a5dd-1667-414e-bbaa-1980596b82e5'} Apr 20 05:37:05 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. Apr 20 05:37:05 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Returning 404 to user: Instance 0156a5dd-1667-414e-bbaa-1980596b82e5 could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:37:05 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-708953b2-bc30-4746-a852-2ccb3e0513de tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5" status: 404 len: 111 microversion: 2.1 time: 0.037557 Apr 20 05:37:05 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:05 2023] GET /compute/v2.1/servers/0156a5dd-1667-414e-bbaa-1980596b82e5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:37:05 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-821327da-389a-481c-b9a2-80317945f955 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 204 len: 0 microversion: 2.1 time: 0.110357 Apr 20 05:37:05 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 127/370] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:37:05 2023] DELETE /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-3166f57f-3ef2-4419-8f3f-fd2684639149 req-f86b8254-79e9-440c-aba8-fe98eafd85d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ddf1a2-942d-4240-afbe-20194c1845ca", "name": "network-vif-unplugged", "status": "completed", "tag": "00934807-0f00-4feb-872a-b5e8c89789f3"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-3166f57f-3ef2-4419-8f3f-fd2684639149 req-f86b8254-79e9-440c-aba8-fe98eafd85d8 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-3166f57f-3ef2-4419-8f3f-fd2684639149 req-f86b8254-79e9-440c-aba8-fe98eafd85d8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-3166f57f-3ef2-4419-8f3f-fd2684639149 req-f86b8254-79e9-440c-aba8-fe98eafd85d8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:05 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-3166f57f-3ef2-4419-8f3f-fd2684639149 req-f86b8254-79e9-440c-aba8-fe98eafd85d8 service nova] Creating event network-vif-unplugged:00934807-0f00-4feb-872a-b5e8c89789f3 for instance 75ddf1a2-942d-4240-afbe-20194c1845ca on user Apr 20 05:37:05 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-3166f57f-3ef2-4419-8f3f-fd2684639149 req-f86b8254-79e9-440c-aba8-fe98eafd85d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029542 Apr 20 05:37:05 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 125/371] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:05 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '198edaee95b0445b8cb018046d790576', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e0e7a7d59fd49c3aaaedbf085980c96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:05 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-026a9939-a7c4-46e1-bf4d-dacb161cc974 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 200 len: 1499 microversion: 2.1 time: 0.397517 Apr 20 05:37:05 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 120/372] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:05 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 1499 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:37:06 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-49dda340-32ab-4251-b2fe-f3a961a0751f req-e02945ab-cb46-427e-be5e-8bcb814903c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ddf1a2-942d-4240-afbe-20194c1845ca", "name": "network-vif-deleted", "tag": "00934807-0f00-4feb-872a-b5e8c89789f3"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-49dda340-32ab-4251-b2fe-f3a961a0751f req-e02945ab-cb46-427e-be5e-8bcb814903c4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-49dda340-32ab-4251-b2fe-f3a961a0751f req-e02945ab-cb46-427e-be5e-8bcb814903c4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:06 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-49dda340-32ab-4251-b2fe-f3a961a0751f req-e02945ab-cb46-427e-be5e-8bcb814903c4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:06 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-49dda340-32ab-4251-b2fe-f3a961a0751f req-e02945ab-cb46-427e-be5e-8bcb814903c4 service nova] Creating event network-vif-deleted:00934807-0f00-4feb-872a-b5e8c89789f3 for instance 75ddf1a2-942d-4240-afbe-20194c1845ca on user Apr 20 05:37:06 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-49dda340-32ab-4251-b2fe-f3a961a0751f req-e02945ab-cb46-427e-be5e-8bcb814903c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029103 Apr 20 05:37:06 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 128/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-cedd4970-f242-4fbd-93d2-d0b006005094 req-f27c1b83-7009-4d7c-931d-637c5d8da59b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75ddf1a2-942d-4240-afbe-20194c1845ca", "name": "network-vif-plugged", "status": "completed", "tag": "00934807-0f00-4feb-872a-b5e8c89789f3"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-cedd4970-f242-4fbd-93d2-d0b006005094 req-f27c1b83-7009-4d7c-931d-637c5d8da59b service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-cedd4970-f242-4fbd-93d2-d0b006005094 req-f27c1b83-7009-4d7c-931d-637c5d8da59b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-cedd4970-f242-4fbd-93d2-d0b006005094 req-f27c1b83-7009-4d7c-931d-637c5d8da59b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-cedd4970-f242-4fbd-93d2-d0b006005094 req-f27c1b83-7009-4d7c-931d-637c5d8da59b service nova] Creating event network-vif-plugged:00934807-0f00-4feb-872a-b5e8c89789f3 for instance 75ddf1a2-942d-4240-afbe-20194c1845ca on user Apr 20 05:37:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-cedd4970-f242-4fbd-93d2-d0b006005094 req-f27c1b83-7009-4d7c-931d-637c5d8da59b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029997 Apr 20 05:37:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 126/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=8 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:15 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:15 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-66dee81d-7fa4-4d65-bf7b-2b81e9c8e5d8 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 200 len: 1537 microversion: 2.1 time: 0.252818 Apr 20 05:37:15 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 121/375] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:15 2023] GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Searching by: {'deleted': False, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e'} {{(pid=72596) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:16 user devstack@n-api.service[72596]: DEBUG nova.compute.multi_cell_list [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 05:37:16 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-363581f6-9bb9-4a0b-84f8-d9a946fc17a5 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.189496 Apr 20 05:37:16 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 129/376] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 05:37:15 2023] GET /compute/v2.1/servers => generated 341 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:16 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:16 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-4ac15cfd-cff9-4ff1-a7ea-8c83baa3dcd4 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 200 len: 1537 microversion: 2.1 time: 0.566546 Apr 20 05:37:16 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 127/377] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:16 2023] GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 1537 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:37:18 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-34718a78-4fd2-42e7-beca-f5726167f2bf tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 204 len: 0 microversion: 2.1 time: 0.117985 Apr 20 05:37:18 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 122/378] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:37:18 2023] DELETE /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:18 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:18 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-6de3bdd3-a07a-462e-9dfa-06a2c2c37544 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 200 len: 1543 microversion: 2.1 time: 0.199736 Apr 20 05:37:18 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 130/379] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:18 2023] GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 1543 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:37:18 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-0c6cc8ef-482d-493c-9bbd-315521b97896 req-897fc82f-2c84-4b15-b4ff-81b3ec809151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a420a0f-1dba-4fdc-937f-3a77bccfeb2a", "name": "network-vif-unplugged", "status": "completed", "tag": "b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-0c6cc8ef-482d-493c-9bbd-315521b97896 req-897fc82f-2c84-4b15-b4ff-81b3ec809151 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-0c6cc8ef-482d-493c-9bbd-315521b97896 req-897fc82f-2c84-4b15-b4ff-81b3ec809151 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-0c6cc8ef-482d-493c-9bbd-315521b97896 req-897fc82f-2c84-4b15-b4ff-81b3ec809151 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:18 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-0c6cc8ef-482d-493c-9bbd-315521b97896 req-897fc82f-2c84-4b15-b4ff-81b3ec809151 service nova] Creating event network-vif-unplugged:b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3 for instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a on user Apr 20 05:37:18 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-0c6cc8ef-482d-493c-9bbd-315521b97896 req-897fc82f-2c84-4b15-b4ff-81b3ec809151 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029483 Apr 20 05:37:18 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 128/380] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:19 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:37:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-69501223-22c0-49fa-afa3-639568604937 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 204 len: 0 microversion: 2.1 time: 0.264377 Apr 20 05:37:19 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 123/381] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:37:18 2023] DELETE /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-5dcee105-94dd-4e88-9b25-4c2223f0916d req-a8071a0c-0df1-497d-9679-ca9a36a3ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "name": "network-vif-unplugged", "status": "completed", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-5dcee105-94dd-4e88-9b25-4c2223f0916d req-a8071a0c-0df1-497d-9679-ca9a36a3ab56 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-5dcee105-94dd-4e88-9b25-4c2223f0916d req-a8071a0c-0df1-497d-9679-ca9a36a3ab56 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:19 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-5dcee105-94dd-4e88-9b25-4c2223f0916d req-a8071a0c-0df1-497d-9679-ca9a36a3ab56 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-5dcee105-94dd-4e88-9b25-4c2223f0916d req-a8071a0c-0df1-497d-9679-ca9a36a3ab56 service nova] Creating event network-vif-unplugged:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:37:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-5dcee105-94dd-4e88-9b25-4c2223f0916d req-a8071a0c-0df1-497d-9679-ca9a36a3ab56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034179 Apr 20 05:37:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 129/382] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:19 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6beb804304e94477ba224d9066ede268', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83045a7a115e4207b19dab56c08be584', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:37:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-a49c2c1a-751e-412b-80e5-da9393cf6bf7 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 200 len: 1664 microversion: 2.1 time: 0.276732 Apr 20 05:37:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 131/383] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:19 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 1664 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:37:19 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-d5ddf98f-9e78-45c5-900e-30c2cbeacf67 req-ced7a90c-5984-4c1c-9d16-27e4a0401227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a420a0f-1dba-4fdc-937f-3a77bccfeb2a", "name": "network-vif-deleted", "tag": "b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-d5ddf98f-9e78-45c5-900e-30c2cbeacf67 req-ced7a90c-5984-4c1c-9d16-27e4a0401227 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-d5ddf98f-9e78-45c5-900e-30c2cbeacf67 req-ced7a90c-5984-4c1c-9d16-27e4a0401227 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:19 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-d5ddf98f-9e78-45c5-900e-30c2cbeacf67 req-ced7a90c-5984-4c1c-9d16-27e4a0401227 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-d5ddf98f-9e78-45c5-900e-30c2cbeacf67 req-ced7a90c-5984-4c1c-9d16-27e4a0401227 service nova] Creating event network-vif-deleted:b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3 for instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a on user Apr 20 05:37:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-d5ddf98f-9e78-45c5-900e-30c2cbeacf67 req-ced7a90c-5984-4c1c-9d16-27e4a0401227 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033877 Apr 20 05:37:19 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 124/384] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:20 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-36340506-a410-41d0-9c16-13ef24bcc955 req-ed687759-7a98-4c51-a344-00780c6e0005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a420a0f-1dba-4fdc-937f-3a77bccfeb2a", "name": "network-vif-plugged", "status": "completed", "tag": "b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-36340506-a410-41d0-9c16-13ef24bcc955 req-ed687759-7a98-4c51-a344-00780c6e0005 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-36340506-a410-41d0-9c16-13ef24bcc955 req-ed687759-7a98-4c51-a344-00780c6e0005 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:20 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-36340506-a410-41d0-9c16-13ef24bcc955 req-ed687759-7a98-4c51-a344-00780c6e0005 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:20 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-36340506-a410-41d0-9c16-13ef24bcc955 req-ed687759-7a98-4c51-a344-00780c6e0005 service nova] Creating event network-vif-plugged:b59aa786-c516-43ca-a4f0-3eb4ebb5bbd3 for instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a on user Apr 20 05:37:20 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-36340506-a410-41d0-9c16-13ef24bcc955 req-ed687759-7a98-4c51-a344-00780c6e0005 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100197 Apr 20 05:37:20 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 130/385] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:21 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-31853b30-65a8-4959-ba05-f99fce113506 req-fda1d1d4-3216-4a92-81bd-ca6c9505fb0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "name": "network-vif-plugged", "status": "completed", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-31853b30-65a8-4959-ba05-f99fce113506 req-fda1d1d4-3216-4a92-81bd-ca6c9505fb0a service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-31853b30-65a8-4959-ba05-f99fce113506 req-fda1d1d4-3216-4a92-81bd-ca6c9505fb0a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:21 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-31853b30-65a8-4959-ba05-f99fce113506 req-fda1d1d4-3216-4a92-81bd-ca6c9505fb0a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-31853b30-65a8-4959-ba05-f99fce113506 req-fda1d1d4-3216-4a92-81bd-ca6c9505fb0a service nova] Creating event network-vif-plugged:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:37:21 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-31853b30-65a8-4959-ba05-f99fce113506 req-fda1d1d4-3216-4a92-81bd-ca6c9505fb0a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027630 Apr 20 05:37:21 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 132/386] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:21 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-6ad78a58-80e4-4c58-873c-27fecdd04e0f req-018dc9c7-c2f5-43da-89a9-93fa7bfca748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bdff10-3d1f-491e-8d7b-f4c0a0260dcd", "name": "network-vif-deleted", "tag": "336c792a-33d3-4a9e-b2f4-d1de6a3e1c32"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:37:21 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-6ad78a58-80e4-4c58-873c-27fecdd04e0f req-018dc9c7-c2f5-43da-89a9-93fa7bfca748 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:21 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-6ad78a58-80e4-4c58-873c-27fecdd04e0f req-018dc9c7-c2f5-43da-89a9-93fa7bfca748 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:21 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-6ad78a58-80e4-4c58-873c-27fecdd04e0f req-018dc9c7-c2f5-43da-89a9-93fa7bfca748 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:21 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-6ad78a58-80e4-4c58-873c-27fecdd04e0f req-018dc9c7-c2f5-43da-89a9-93fa7bfca748 service nova] Creating event network-vif-deleted:336c792a-33d3-4a9e-b2f4-d1de6a3e1c32 for instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd on user Apr 20 05:37:21 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-6ad78a58-80e4-4c58-873c-27fecdd04e0f req-018dc9c7-c2f5-43da-89a9-93fa7bfca748 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027897 Apr 20 05:37:21 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 125/387] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:37:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] [instance: 80626649-9627-4a00-abcb-a307ac8c15bf] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:35 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] HTTP exception thrown: Instance 80626649-9627-4a00-abcb-a307ac8c15bf could not be found. Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Request method failure captured: Apr 20 05:37:35 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf HTTP/1.1 Apr 20 05:37:35 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:37:35 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:37:35 user devstack@n-api.service[72597]: Connection: close Apr 20 05:37:35 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:37:35 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:37:35 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:37:35 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:37:35 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM5N88SZIhueFE44VVtmDeyEefn34__CNhVZRd-ygUhicOeojVWULmfVCFGbej5oqx4nk0vv7RuF3g9UHLsZ8CVLQMPHeA4_15y3QQIh6GCJABaejdsV2A0iIaaI1BIfis7ObxCUDsVFnS0TvpPq3LWYMcJCkDK20i8AeseyOe2sQ3U Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Project-Id: 43425b2c00284dc48e18d06e1a8e21e5 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Project-Name: tempest-VolumesAdminNegativeTest-849033716 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/43425b2c00284dc48e18d06e1a8e21e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/43425b2c00284dc48e18d06e1a8e21e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/43425b2c00284dc48e18d06e1a8e21e5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Tenant: tempest-VolumesAdminNegativeTest-849033716 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Tenant-Id: 43425b2c00284dc48e18d06e1a8e21e5 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-849033716 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-User: tempest-VolumesAdminNegativeTest-849033716-project-member Apr 20 05:37:35 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:37:35 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:37:35 user devstack@n-api.service[72597]: X-User-Id: 4eb937659897494cb185f8f5ce7f8b22 Apr 20 05:37:35 user devstack@n-api.service[72597]: X-User-Name: tempest-VolumesAdminNegativeTest-849033716-project-member Apr 20 05:37:35 user devstack@n-api.service[72597]: method: > Apr 20 05:37:35 user devstack@n-api.service[72597]: exception: Instance 80626649-9627-4a00-abcb-a307ac8c15bf could not be found. Apr 20 05:37:35 user devstack@n-api.service[72597]: action_args: {'id': '80626649-9627-4a00-abcb-a307ac8c15bf'} Apr 20 05:37:35 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80626649-9627-4a00-abcb-a307ac8c15bf could not be found. Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80626649-9627-4a00-abcb-a307ac8c15bf could not be found. Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80626649-9627-4a00-abcb-a307ac8c15bf could not be found. Apr 20 05:37:35 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:35 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Returning 404 to user: Instance 80626649-9627-4a00-abcb-a307ac8c15bf could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:37:35 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-31b15927-79c4-4012-b9c6-f041d2e2a2e6 tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf" status: 404 len: 111 microversion: 2.1 time: 0.226659 Apr 20 05:37:35 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 131/388] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:35 2023] GET /compute/v2.1/servers/80626649-9627-4a00-abcb-a307ac8c15bf => generated 111 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:37:35 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:35 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:35 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:35 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-d615facc-8e07-4285-8b4a-f6fbf747c71b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] Calling method '.version_select at 0x7ff3028909d0>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:35 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-d615facc-8e07-4285-8b4a-f6fbf747c71b tempest-VolumesAdminNegativeTest-849033716 tempest-VolumesAdminNegativeTest-849033716-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214828661" status: 202 len: 0 microversion: 2.1 time: 0.033746 Apr 20 05:37:35 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 133/389] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 05:37:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1214828661 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] [instance: d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:51 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] HTTP exception thrown: Instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 could not be found. Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Request method failure captured: Apr 20 05:37:51 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 HTTP/1.1 Apr 20 05:37:51 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:37:51 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:37:51 user devstack@n-api.service[72598]: Connection: close Apr 20 05:37:51 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:37:51 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:37:51 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:37:51 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:37:51 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM165r8zqHmCsou-O3eC_SwFetKJgys3yS1vQYllHFUXXnq9-EgvLvGsJcBGYTecRpSUKpPFpGdASpgUr4a-KiCWYUHe84gKGFMc0idZCUgfZMdRLlQ_hyYS3Mq1STskHbDHrSvBQZNzKToOoS2iTAq87t39n5RGtQmfth8nF-5eKM0 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Project-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/29f76ebb01544478b555aff667debbd3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/29f76ebb01544478b555aff667debbd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Tenant-Id: 29f76ebb01544478b555aff667debbd3 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:37:51 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:37:51 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:37:51 user devstack@n-api.service[72598]: X-User-Id: 82ae116ab3d844afa141c1186f2f63d9 Apr 20 05:37:51 user devstack@n-api.service[72598]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member Apr 20 05:37:51 user devstack@n-api.service[72598]: method: > Apr 20 05:37:51 user devstack@n-api.service[72598]: exception: Instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 could not be found. Apr 20 05:37:51 user devstack@n-api.service[72598]: action_args: {'id': 'd8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41'} Apr 20 05:37:51 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 could not be found. Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 could not be found. Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 could not be found. Apr 20 05:37:51 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:37:51 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] Returning 404 to user: Instance d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:37:51 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-77e6a055-1f3b-4ce9-83bb-adfd73f56426 tempest-ServerBootFromVolumeStableRescueTest-1879280447 tempest-ServerBootFromVolumeStableRescueTest-1879280447-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41" status: 404 len: 111 microversion: 2.87 time: 0.040583 Apr 20 05:37:51 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 126/390] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 05:37:51 2023] GET /compute/v2.1/servers/d8c0d44c-46cf-4fb6-b9a4-45f26f8f6f41 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] [instance: 75ddf1a2-942d-4240-afbe-20194c1845ca] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:37:56 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] HTTP exception thrown: Instance 75ddf1a2-942d-4240-afbe-20194c1845ca could not be found. Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Request method failure captured: Apr 20 05:37:56 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca HTTP/1.1 Apr 20 05:37:56 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:37:56 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:37:56 user devstack@n-api.service[72597]: Connection: close Apr 20 05:37:56 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:37:56 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:37:56 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:37:56 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:37:56 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM15L4z_Hah_uMb7Zq2aXeiR27dykOqtPffUAmGsLN-dJUgnyoc7J2CAqW9omj3tM46RzvwUtanaN_KVky7MxxrkbfVMHc-O1qBKTDfr_UBgU_IFmfFqnapJi3hB5qRCflJJ5v7CBbI3PDVDfyyO_WjfGdYorDurh2Rzeax6oOvVp_M Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Project-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Project-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4e0e7a7d59fd49c3aaaedbf085980c96"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Tenant: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Tenant-Id: 4e0e7a7d59fd49c3aaaedbf085980c96 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-ServersNegativeTestJSON-232859312 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-User: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:37:56 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:37:56 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:37:56 user devstack@n-api.service[72597]: X-User-Id: 198edaee95b0445b8cb018046d790576 Apr 20 05:37:56 user devstack@n-api.service[72597]: X-User-Name: tempest-ServersNegativeTestJSON-232859312-project-member Apr 20 05:37:56 user devstack@n-api.service[72597]: method: > Apr 20 05:37:56 user devstack@n-api.service[72597]: exception: Instance 75ddf1a2-942d-4240-afbe-20194c1845ca could not be found. Apr 20 05:37:56 user devstack@n-api.service[72597]: action_args: {'id': '75ddf1a2-942d-4240-afbe-20194c1845ca'} Apr 20 05:37:56 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75ddf1a2-942d-4240-afbe-20194c1845ca could not be found. Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75ddf1a2-942d-4240-afbe-20194c1845ca could not be found. Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75ddf1a2-942d-4240-afbe-20194c1845ca could not be found. Apr 20 05:37:56 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:37:56 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] Returning 404 to user: Instance 75ddf1a2-942d-4240-afbe-20194c1845ca could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:37:56 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-a222235a-ebf0-4ff3-b2b0-7a6be674d1b0 tempest-ServersNegativeTestJSON-232859312 tempest-ServersNegativeTestJSON-232859312-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca" status: 404 len: 111 microversion: 2.1 time: 0.037893 Apr 20 05:37:56 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 132/391] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:37:56 2023] GET /compute/v2.1/servers/75ddf1a2-942d-4240-afbe-20194c1845ca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:08 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] HTTP exception thrown: Instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a could not be found. Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Request method failure captured: Apr 20 05:38:08 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a HTTP/1.1 Apr 20 05:38:08 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:38:08 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:38:08 user devstack@n-api.service[72596]: Connection: close Apr 20 05:38:08 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:38:08 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:38:08 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:38:08 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:38:08 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM8T1v3-hQyP0S4liTnM4l2jcFMvXo8VJytZFBoBB1980f0J3o9N2ToywGvXz56qTFcKloALPy8KiW9u0fkr0SyMw4bJlP-0jnR6j4_1pPWpk9yjwkcigTuS_-lFsuO7daVaYlb6-x5dUiMBPDS-_4W6EdUMY1tf4aFXwcEfcj2-4rM Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Project-Id: 933c341c0bcc47a5927fd8961b4fea9e Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Project-Name: tempest-TestMinimumBasicScenario-945306862 Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/933c341c0bcc47a5927fd8961b4fea9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/933c341c0bcc47a5927fd8961b4fea9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/933c341c0bcc47a5927fd8961b4fea9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Tenant: tempest-TestMinimumBasicScenario-945306862 Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Tenant-Id: 933c341c0bcc47a5927fd8961b4fea9e Apr 20 05:38:08 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-TestMinimumBasicScenario-945306862 Apr 20 05:38:08 user devstack@n-api.service[72596]: X-User: tempest-TestMinimumBasicScenario-945306862-project-member Apr 20 05:38:08 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:38:08 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:38:08 user devstack@n-api.service[72596]: X-User-Id: 151ab31d22b943519eb10b95b8542cc5 Apr 20 05:38:08 user devstack@n-api.service[72596]: X-User-Name: tempest-TestMinimumBasicScenario-945306862-project-member Apr 20 05:38:08 user devstack@n-api.service[72596]: method: > Apr 20 05:38:08 user devstack@n-api.service[72596]: exception: Instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a could not be found. Apr 20 05:38:08 user devstack@n-api.service[72596]: action_args: {'id': '1a420a0f-1dba-4fdc-937f-3a77bccfeb2a'} Apr 20 05:38:08 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a could not be found. Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a could not be found. Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a could not be found. Apr 20 05:38:08 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:38:08 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Returning 404 to user: Instance 1a420a0f-1dba-4fdc-937f-3a77bccfeb2a could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:38:08 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-1aa9e0c3-464e-44e3-a046-72a122559b69 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a" status: 404 len: 111 microversion: 2.1 time: 0.032253 Apr 20 05:38:08 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 134/392] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:38:08 2023] GET /compute/v2.1/servers/1a420a0f-1dba-4fdc-937f-3a77bccfeb2a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:38:08 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-a690758d-c394-4e7e-a44e-c25a78943593 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '.version_select at 0x7ff3029a60e0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:08 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:08 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:08 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-a690758d-c394-4e7e-a44e-c25a78943593 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-505941647" status: 202 len: 0 microversion: 2.1 time: 0.027274 Apr 20 05:38:08 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 127/393] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 05:38:08 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-505941647 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] [instance: 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] HTTP exception thrown: Instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd could not be found. Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Request method failure captured: Apr 20 05:38:09 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd HTTP/1.1 Apr 20 05:38:09 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:38:09 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:38:09 user devstack@n-api.service[72597]: Connection: close Apr 20 05:38:09 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:38:09 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:38:09 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:38:09 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:38:09 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM1wuZrsJCKiIqflpmB5no9yBNQ2DEhoo0KHHYJci_rnC5cARl9oTWsbEzeToPkLdDINBruWgvUa9ssdc-4QerTZF-CV-C-mPfV6C79ABnHXfBQGuvfU15Ev0YeNDFcedbVhUOK4CfMoQgzU7XgQ3ic3PUs_oD5SJgN0tIXG11N5lFg Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Project-Id: 83045a7a115e4207b19dab56c08be584 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Project-Name: tempest-ServerActionsTestJSON-1221325113 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83045a7a115e4207b19dab56c08be584"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/83045a7a115e4207b19dab56c08be584"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/83045a7a115e4207b19dab56c08be584"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Tenant: tempest-ServerActionsTestJSON-1221325113 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Tenant-Id: 83045a7a115e4207b19dab56c08be584 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-ServerActionsTestJSON-1221325113 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-User: tempest-ServerActionsTestJSON-1221325113-project-member Apr 20 05:38:09 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:38:09 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:38:09 user devstack@n-api.service[72597]: X-User-Id: 6beb804304e94477ba224d9066ede268 Apr 20 05:38:09 user devstack@n-api.service[72597]: X-User-Name: tempest-ServerActionsTestJSON-1221325113-project-member Apr 20 05:38:09 user devstack@n-api.service[72597]: method: > Apr 20 05:38:09 user devstack@n-api.service[72597]: exception: Instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd could not be found. Apr 20 05:38:09 user devstack@n-api.service[72597]: action_args: {'id': '14bdff10-3d1f-491e-8d7b-f4c0a0260dcd'} Apr 20 05:38:09 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd could not be found. Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd could not be found. Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd could not be found. Apr 20 05:38:09 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:38:09 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Returning 404 to user: Instance 14bdff10-3d1f-491e-8d7b-f4c0a0260dcd could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:38:09 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-1b310f84-5452-456d-8813-f7536f284984 tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd" status: 404 len: 111 microversion: 2.1 time: 0.030619 Apr 20 05:38:09 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 133/394] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:38:09 2023] GET /compute/v2.1/servers/14bdff10-3d1f-491e-8d7b-f4c0a0260dcd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 05:38:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-2349f1c1-154c-46f0-b835-f560ddc3d3eb tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] Calling method '.version_select at 0x7ff3028939a0>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-2349f1c1-154c-46f0-b835-f560ddc3d3eb tempest-ServerActionsTestJSON-1221325113 tempest-ServerActionsTestJSON-1221325113-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-840035893" status: 202 len: 0 microversion: 2.1 time: 0.056983 Apr 20 05:38:09 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 135/395] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 05:38:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-840035893 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:38:11 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-308feb21-012b-4e26-8e48-e7eca9bca000 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Action: 'create', calling method: .version_select at 0x7ff30281d870>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1501039756", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaNd8HMlZ8lW0RpGZJJpw5obd2dbGPMkjv5bu9Yn8QRKcXOU4IJQ7xf9A8n6/Dy6cN/YBvJxeRwhGS6K/Sj1o0diw8hNY1Ad5w+Z2GuHajRkS52RIBNE32TkIoftJ+xeQ=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:11 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-308feb21-012b-4e26-8e48-e7eca9bca000 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:11 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-308feb21-012b-4e26-8e48-e7eca9bca000 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for user 151ab31d22b943519eb10b95b8542cc5 and project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:11 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-308feb21-012b-4e26-8e48-e7eca9bca000 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054533 Apr 20 05:38:11 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 128/396] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:38:11 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:11 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1155041720", "imageRef": "aea58d6c-8958-49db-a421-0b889809e7ff", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1501039756", "networks": [{"uuid": "6808a39f-22cd-436a-8bc9-834a064db94c"}]}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:11 user devstack@n-api.service[72597]: DEBUG nova.network.neutron [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] validate_networks() for [('6808a39f-22cd-436a-8bc9-834a064db94c', None, None, None, None, None)] {{(pid=72597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Flavor limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Image limits 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Flavor pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Image pref 0:0:0 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.virt.hardware [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Getting quotas for user 151ab31d22b943519eb10b95b8542cc5 and project 933c341c0bcc47a5927fd8961b4fea9e. Resources: {'cores', 'ram', 'instances'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Going to run 1 instances... {{(pid=72597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:38:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aea58d6c-8958-49db-a421-0b889809e7ff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:38:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7217ebb1-7d1a-44f5-8db8-cfb86896e784 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.885097 Apr 20 05:38:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 134/397] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:38:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:38:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c8580e2c-882e-4291-a84b-a117f8404aeb tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:12 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c8580e2c-882e-4291-a84b-a117f8404aeb tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:38:12 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-c8580e2c-882e-4291-a84b-a117f8404aeb tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:38:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-c8580e2c-882e-4291-a84b-a117f8404aeb tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 200 len: 1253 microversion: 2.1 time: 0.361829 Apr 20 05:38:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 136/398] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:38:12 2023] GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 1253 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:38:15 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-faa43ad5-f4ba-41e9-a892-1a3d2865c206 req-a2b0db98-b3aa-43fa-841d-6edf1e178ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "526b246a-2399-48c3-b422-d62065c10078", "tag": "7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-faa43ad5-f4ba-41e9-a892-1a3d2865c206 req-a2b0db98-b3aa-43fa-841d-6edf1e178ab8 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-faa43ad5-f4ba-41e9-a892-1a3d2865c206 req-a2b0db98-b3aa-43fa-841d-6edf1e178ab8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:15 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-faa43ad5-f4ba-41e9-a892-1a3d2865c206 req-a2b0db98-b3aa-43fa-841d-6edf1e178ab8 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:15 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-faa43ad5-f4ba-41e9-a892-1a3d2865c206 req-a2b0db98-b3aa-43fa-841d-6edf1e178ab8 service nova] Creating event network-changed:7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f for instance 526b246a-2399-48c3-b422-d62065c10078 on user Apr 20 05:38:15 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-faa43ad5-f4ba-41e9-a892-1a3d2865c206 req-a2b0db98-b3aa-43fa-841d-6edf1e178ab8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029035 Apr 20 05:38:15 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 129/399] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:17 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-8a5a82f4-0ee6-453f-9772-a19486a1b813 req-0a931585-99b2-40b4-8d5a-7fa1c17a468a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526b246a-2399-48c3-b422-d62065c10078", "name": "network-vif-plugged", "status": "completed", "tag": "7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:17 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-8a5a82f4-0ee6-453f-9772-a19486a1b813 req-0a931585-99b2-40b4-8d5a-7fa1c17a468a service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:17 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-8a5a82f4-0ee6-453f-9772-a19486a1b813 req-0a931585-99b2-40b4-8d5a-7fa1c17a468a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:17 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-8a5a82f4-0ee6-453f-9772-a19486a1b813 req-0a931585-99b2-40b4-8d5a-7fa1c17a468a service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-8a5a82f4-0ee6-453f-9772-a19486a1b813 req-0a931585-99b2-40b4-8d5a-7fa1c17a468a service nova] Creating event network-vif-plugged:7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f for instance 526b246a-2399-48c3-b422-d62065c10078 on user Apr 20 05:38:17 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-8a5a82f4-0ee6-453f-9772-a19486a1b813 req-0a931585-99b2-40b4-8d5a-7fa1c17a468a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032203 Apr 20 05:38:17 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:19 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:19 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-aa9a5628-2a34-4925-b65d-5cdd24eabc07 req-ce374b90-bbb2-4d25-8691-99056c0f44f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526b246a-2399-48c3-b422-d62065c10078", "name": "network-vif-plugged", "status": "completed", "tag": "7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-aa9a5628-2a34-4925-b65d-5cdd24eabc07 req-ce374b90-bbb2-4d25-8691-99056c0f44f5 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-aa9a5628-2a34-4925-b65d-5cdd24eabc07 req-ce374b90-bbb2-4d25-8691-99056c0f44f5 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-aa9a5628-2a34-4925-b65d-5cdd24eabc07 req-ce374b90-bbb2-4d25-8691-99056c0f44f5 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-aa9a5628-2a34-4925-b65d-5cdd24eabc07 req-ce374b90-bbb2-4d25-8691-99056c0f44f5 service nova] Creating event network-vif-plugged:7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f for instance 526b246a-2399-48c3-b422-d62065c10078 on user Apr 20 05:38:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-aa9a5628-2a34-4925-b65d-5cdd24eabc07 req-ce374b90-bbb2-4d25-8691-99056c0f44f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029119 Apr 20 05:38:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 137/401] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:22 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=4 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:22 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-429134067", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "d01c1d7e-e6ec-46c7-a160-679b15626343"}]}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:22 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] validate_networks() for [('d01c1d7e-e6ec-46c7-a160-679b15626343', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Getting quotas for project 3b35b59c7df742798e854837cc2df719. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Getting quotas for user e47226cac2f843acaacca27801a0d415 and project 3b35b59c7df742798e854837cc2df719. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:38:24 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:38:24 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-7db74933-5f06-443c-985f-bb745fce7886 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.733593 Apr 20 05:38:24 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 130/402] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:38:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 1735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:38:24 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:24 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:24 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-3116d906-5c81-4b6d-b276-1f581c283384 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:24 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-3116d906-5c81-4b6d-b276-1f581c283384 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:38:24 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-3116d906-5c81-4b6d-b276-1f581c283384 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47226cac2f843acaacca27801a0d415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b35b59c7df742798e854837cc2df719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:38:24 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-3116d906-5c81-4b6d-b276-1f581c283384 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b" status: 200 len: 1207 microversion: 2.1 time: 0.116350 Apr 20 05:38:24 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 136/403] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:38:24 2023] GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b => generated 1207 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:38:24 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:24 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-1d371999-bb4c-4dec-923a-3c2f3d739c14 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Action: 'create', calling method: .version_select at 0x7ff3028923b0>, body: {"keypair": {"name": "tempest-keypair-240490223", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVj9+D7oRsqvTYnHcLCIw6LsZdQOZnWBC7EgeWmmYc2Pwg0cRNr1pyls3wF055FhrGQVfNTLFfcUgF6nOfU6ndxnP5RUkIdi9ryD7x8/ksSmOTVpXmMeEYvC7xB7vWIlw=="}} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:24 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-1d371999-bb4c-4dec-923a-3c2f3d739c14 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Getting quotas for project e5adc23748b041639625884af10dc569. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:24 user devstack@n-api.service[72596]: DEBUG nova.quota [None req-1d371999-bb4c-4dec-923a-3c2f3d739c14 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Getting quotas for user d186e766b78344a295b352fbfcccbab3 and project e5adc23748b041639625884af10dc569. Resources: {'key_pairs'} {{(pid=72596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:24 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-1d371999-bb4c-4dec-923a-3c2f3d739c14 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.189741 Apr 20 05:38:24 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 138/404] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:38:24 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 05:38:26 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-2102937581", "imageRef": "8d345021-146e-473e-8740-41c1850cd33e", "flavorRef": "42", "networks": [{"uuid": "0f049a9f-9d24-4083-abdb-7d878e9913e7"}], "security_groups": [{"name": "tempest-securitygroup--179601921"}], "key_name": "tempest-keypair-240490223", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:26 user devstack@n-api.service[72598]: DEBUG nova.network.neutron [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] validate_networks() for [('0f049a9f-9d24-4083-abdb-7d878e9913e7', None, None, None, None, None)] {{(pid=72598) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Flavor limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Image limits 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Flavor pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Image pref 0:0:0 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.virt.hardware [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72598) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Getting quotas for project e5adc23748b041639625884af10dc569. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Getting quotas for user d186e766b78344a295b352fbfcccbab3 and project e5adc23748b041639625884af10dc569. Resources: {'cores', 'ram', 'instances'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Going to run 1 instances... {{(pid=72598) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 05:38:27 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8d345021-146e-473e-8740-41c1850cd33e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=72598) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 05:38:27 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-3823ad00-60d1-419f-9a5a-1f29e6a4df64 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.748626 Apr 20 05:38:27 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 131/405] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 05:38:26 2023] POST /compute/v2.1/servers => generated 403 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 05:38:27 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7a15026d-cd9b-49d9-80dc-7372a9e360b0 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:27 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7a15026d-cd9b-49d9-80dc-7372a9e360b0 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:38:27 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-7a15026d-cd9b-49d9-80dc-7372a9e360b0 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd186e766b78344a295b352fbfcccbab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5adc23748b041639625884af10dc569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:38:27 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7a15026d-cd9b-49d9-80dc-7372a9e360b0 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 200 len: 1239 microversion: 2.1 time: 0.067751 Apr 20 05:38:27 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 137/406] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:38:27 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:38:27 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-a86ee21d-cc36-4a06-89c5-6ade43a0b111 req-226c4f77-7cb7-4a61-9cc7-92fcaafc84f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b", "tag": "3d86603a-0e8e-4603-ad53-5bb70894c3e9"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:27 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-a86ee21d-cc36-4a06-89c5-6ade43a0b111 req-226c4f77-7cb7-4a61-9cc7-92fcaafc84f7 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:27 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-a86ee21d-cc36-4a06-89c5-6ade43a0b111 req-226c4f77-7cb7-4a61-9cc7-92fcaafc84f7 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:27 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-a86ee21d-cc36-4a06-89c5-6ade43a0b111 req-226c4f77-7cb7-4a61-9cc7-92fcaafc84f7 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:27 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-a86ee21d-cc36-4a06-89c5-6ade43a0b111 req-226c4f77-7cb7-4a61-9cc7-92fcaafc84f7 service nova] Creating event network-changed:3d86603a-0e8e-4603-ad53-5bb70894c3e9 for instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b on user Apr 20 05:38:27 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-a86ee21d-cc36-4a06-89c5-6ade43a0b111 req-226c4f77-7cb7-4a61-9cc7-92fcaafc84f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033739 Apr 20 05:38:27 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 139/407] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:27 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:28 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-e3d356ae-3a53-4592-bf58-ea83a180cab0 tempest-TestVolumeBootPattern-1531161385 tempest-TestVolumeBootPattern-1531161385-project-member] Action: 'create', calling method: .version_select at 0x7ff30281f5b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1601341995", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFekZe05Vfy8KSD6sl5d6dBCdKPpd0q9Nz4BVsz3meLE126jwc0ty5YPfC+6usTMqfe6HN/Q9+7VFA6fg4Uo5pLe9Lw0lSrRaQsJlEGqystm3nVycBGT19kQTC4Se89F3A=="}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:28 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-e3d356ae-3a53-4592-bf58-ea83a180cab0 tempest-TestVolumeBootPattern-1531161385 tempest-TestVolumeBootPattern-1531161385-project-member] Getting quotas for project 9c20e0ae7c1b4b82854b71ca376fe43c. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:28 user devstack@n-api.service[72598]: DEBUG nova.quota [None req-e3d356ae-3a53-4592-bf58-ea83a180cab0 tempest-TestVolumeBootPattern-1531161385 tempest-TestVolumeBootPattern-1531161385-project-member] Getting quotas for user a2492f1d667b48a3b6ffa4a24593dfa6 and project 9c20e0ae7c1b4b82854b71ca376fe43c. Resources: {'key_pairs'} {{(pid=72598) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:28 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-e3d356ae-3a53-4592-bf58-ea83a180cab0 tempest-TestVolumeBootPattern-1531161385 tempest-TestVolumeBootPattern-1531161385-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.051180 Apr 20 05:38:28 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 132/408] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:38:28 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:30 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-ac0999df-b298-4bbf-8e6b-5ffd50b6893e req-a0cebd1d-de85-48a8-9741-98b4e1ef12e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:30 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-ac0999df-b298-4bbf-8e6b-5ffd50b6893e req-a0cebd1d-de85-48a8-9741-98b4e1ef12e2 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-ac0999df-b298-4bbf-8e6b-5ffd50b6893e req-a0cebd1d-de85-48a8-9741-98b4e1ef12e2 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:30 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-ac0999df-b298-4bbf-8e6b-5ffd50b6893e req-a0cebd1d-de85-48a8-9741-98b4e1ef12e2 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:30 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-ac0999df-b298-4bbf-8e6b-5ffd50b6893e req-a0cebd1d-de85-48a8-9741-98b4e1ef12e2 service nova] Creating event network-changed:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:38:30 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-9f01b554-89f7-4148-84a8-f89ba6eb0660 req-dc64dd54-564c-4388-bf89-a59573e2842b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b", "name": "network-vif-plugged", "status": "completed", "tag": "3d86603a-0e8e-4603-ad53-5bb70894c3e9"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:30 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-9f01b554-89f7-4148-84a8-f89ba6eb0660 req-dc64dd54-564c-4388-bf89-a59573e2842b service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:30 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-9f01b554-89f7-4148-84a8-f89ba6eb0660 req-dc64dd54-564c-4388-bf89-a59573e2842b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:30 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-9f01b554-89f7-4148-84a8-f89ba6eb0660 req-dc64dd54-564c-4388-bf89-a59573e2842b service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:30 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-ac0999df-b298-4bbf-8e6b-5ffd50b6893e req-a0cebd1d-de85-48a8-9741-98b4e1ef12e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069947 Apr 20 05:38:30 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 138/409] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:30 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-9f01b554-89f7-4148-84a8-f89ba6eb0660 req-dc64dd54-564c-4388-bf89-a59573e2842b service nova] Creating event network-vif-plugged:3d86603a-0e8e-4603-ad53-5bb70894c3e9 for instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b on user Apr 20 05:38:30 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-9f01b554-89f7-4148-84a8-f89ba6eb0660 req-dc64dd54-564c-4388-bf89-a59573e2842b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030371 Apr 20 05:38:30 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 140/410] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:32 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-e87bea85-dbb1-48ce-ab3e-6b3a10191054 req-8ec27a16-32dc-407f-8ddd-45a16b16f058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b", "name": "network-vif-plugged", "status": "completed", "tag": "3d86603a-0e8e-4603-ad53-5bb70894c3e9"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:32 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-e87bea85-dbb1-48ce-ab3e-6b3a10191054 req-8ec27a16-32dc-407f-8ddd-45a16b16f058 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:32 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-e87bea85-dbb1-48ce-ab3e-6b3a10191054 req-8ec27a16-32dc-407f-8ddd-45a16b16f058 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:32 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-e87bea85-dbb1-48ce-ab3e-6b3a10191054 req-8ec27a16-32dc-407f-8ddd-45a16b16f058 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:32 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-e87bea85-dbb1-48ce-ab3e-6b3a10191054 req-8ec27a16-32dc-407f-8ddd-45a16b16f058 service nova] Creating event network-vif-plugged:3d86603a-0e8e-4603-ad53-5bb70894c3e9 for instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b on user Apr 20 05:38:32 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-e87bea85-dbb1-48ce-ab3e-6b3a10191054 req-8ec27a16-32dc-407f-8ddd-45a16b16f058 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039534 Apr 20 05:38:32 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 133/411] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:33 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-51d167cc-9154-42a0-a464-0616ba617bb0 req-1cfa02b8-0beb-4fe3-9e35-abfb58662d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "name": "network-vif-plugged", "status": "completed", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:33 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-51d167cc-9154-42a0-a464-0616ba617bb0 req-1cfa02b8-0beb-4fe3-9e35-abfb58662d25 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:33 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-51d167cc-9154-42a0-a464-0616ba617bb0 req-1cfa02b8-0beb-4fe3-9e35-abfb58662d25 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:33 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-51d167cc-9154-42a0-a464-0616ba617bb0 req-1cfa02b8-0beb-4fe3-9e35-abfb58662d25 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:33 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-51d167cc-9154-42a0-a464-0616ba617bb0 req-1cfa02b8-0beb-4fe3-9e35-abfb58662d25 service nova] Creating event network-vif-plugged:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:38:33 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-51d167cc-9154-42a0-a464-0616ba617bb0 req-1cfa02b8-0beb-4fe3-9e35-abfb58662d25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063117 Apr 20 05:38:33 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 139/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:33 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-53b90b6e-049d-40fe-8d41-648314f911c0 tempest-TestVolumeBootPattern-1531161385 tempest-TestVolumeBootPattern-1531161385-project-member] Calling method '.version_select at 0x7ff3028928c0>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:33 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-53b90b6e-049d-40fe-8d41-648314f911c0 tempest-TestVolumeBootPattern-1531161385 tempest-TestVolumeBootPattern-1531161385-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1601341995" status: 202 len: 0 microversion: 2.1 time: 0.030931 Apr 20 05:38:33 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 141/413] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 20 05:38:33 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1601341995 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:38:35 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-b20caf40-020b-41d7-99a0-6a8ee51c276c req-bf0515ab-7c3c-4058-b40c-27c54c8366a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "name": "network-vif-plugged", "status": "completed", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:35 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-b20caf40-020b-41d7-99a0-6a8ee51c276c req-bf0515ab-7c3c-4058-b40c-27c54c8366a4 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:38:35 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-b20caf40-020b-41d7-99a0-6a8ee51c276c req-bf0515ab-7c3c-4058-b40c-27c54c8366a4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:38:35 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-b20caf40-020b-41d7-99a0-6a8ee51c276c req-bf0515ab-7c3c-4058-b40c-27c54c8366a4 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:38:35 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-b20caf40-020b-41d7-99a0-6a8ee51c276c req-bf0515ab-7c3c-4058-b40c-27c54c8366a4 service nova] Creating event network-vif-plugged:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:38:35 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-b20caf40-020b-41d7-99a0-6a8ee51c276c req-bf0515ab-7c3c-4058-b40c-27c54c8366a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051322 Apr 20 05:38:35 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 134/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:38:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=4 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:43 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=4 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:43 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c676afdf-aa22-4650-b9ba-96e5d6dcc01a tempest-TestShelveInstance-643227908 tempest-TestShelveInstance-643227908-project-member] Action: 'create', calling method: .version_select at 0x7ff302855870>, body: {"keypair": {"name": "tempest-TestShelveInstance-1569942740", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp5EJ89cgBm5xCuXdbWkXvP8tHANDjzVckfw0Gs19n//5M/ryzg7WEXBlhUbPEXw2aW4TgohHECLz4fL+7cKfGrbNYwHMH/Cvl4ksownUtF7ywWQypmcAl4xrnVyH9l0Q=="}} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:38:43 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-c676afdf-aa22-4650-b9ba-96e5d6dcc01a tempest-TestShelveInstance-643227908 tempest-TestShelveInstance-643227908-project-member] Getting quotas for project 215dae2998c14795be92f7f78c633f42. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 05:38:43 user devstack@n-api.service[72597]: DEBUG nova.quota [None req-c676afdf-aa22-4650-b9ba-96e5d6dcc01a tempest-TestShelveInstance-643227908 tempest-TestShelveInstance-643227908-project-member] Getting quotas for user b4a616cc775f4bd1b0c4c2206e36e44a and project 215dae2998c14795be92f7f78c633f42. Resources: {'key_pairs'} {{(pid=72597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 05:38:43 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-c676afdf-aa22-4650-b9ba-96e5d6dcc01a tempest-TestShelveInstance-643227908 tempest-TestShelveInstance-643227908-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.323932 Apr 20 05:38:43 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 140/415] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 05:38:43 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:38:47 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell0:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:47 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:47 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:38:47 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-0bb4f551-bee2-4bbf-9cd5-549e613b4a81 tempest-TestShelveInstance-643227908 tempest-TestShelveInstance-643227908-project-member] Calling method '.version_select at 0x7ff302827520>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:38:47 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-0bb4f551-bee2-4bbf-9cd5-549e613b4a81 tempest-TestShelveInstance-643227908 tempest-TestShelveInstance-643227908-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1569942740" status: 202 len: 0 microversion: 2.1 time: 0.028146 Apr 20 05:38:47 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 142/416] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 20 05:38:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1569942740 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=4 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell0:SELECT=16 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1,nova_api:INSERT=8 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=10 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:39:02 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:39:03 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:39:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-09be3a3b-c522-42ad-b300-92609641432d tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 200 len: 1537 microversion: 2.1 time: 0.451783 Apr 20 05:39:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 135/417] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:39:02 2023] GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 1537 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=4 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:39:14 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47226cac2f843acaacca27801a0d415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b35b59c7df742798e854837cc2df719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:39:15 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-52193cd8-124f-4640-924e-c9aa10412859 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b" status: 200 len: 1485 microversion: 2.1 time: 0.390227 Apr 20 05:39:15 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 141/418] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:39:14 2023] GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b => generated 1485 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:39:17 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd186e766b78344a295b352fbfcccbab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5adc23748b041639625884af10dc569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:39:17 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-a9924539-15a2-4603-866b-492240049f08 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 200 len: 1552 microversion: 2.1 time: 0.436600 Apr 20 05:39:17 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 143/419] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:39:17 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 1552 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=6 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:03 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:40:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-4a68e211-c57b-4b46-8aa3-602eb67a2184 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 200 len: 1537 microversion: 2.1 time: 0.354047 Apr 20 05:40:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 136/420] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:40:03 2023] GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 1537 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Searching by: {'deleted': False, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e'} {{(pid=72597) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=6 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:03 user devstack@n-api.service[72597]: DEBUG nova.compute.multi_cell_list [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=72597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 05:40:03 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-92262e15-6a07-4b68-8edd-c467165d2501 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.224282 Apr 20 05:40:03 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 142/421] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 05:40:03 2023] GET /compute/v2.1/servers => generated 341 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=6 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:03 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:40:03 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-cedc3a03-8ab6-4ae1-8189-81baf53dd371 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 200 len: 1537 microversion: 2.1 time: 0.164157 Apr 20 05:40:03 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 144/422] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:40:03 2023] GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 1537 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:05 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Going to try to terminate instance {{(pid=72598) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:40:05 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0b9054cf-0f2c-4468-8f58-7d195d958e4c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 204 len: 0 microversion: 2.1 time: 0.125942 Apr 20 05:40:05 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 137/423] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:40:05 2023] DELETE /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:05 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '151ab31d22b943519eb10b95b8542cc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '933c341c0bcc47a5927fd8961b4fea9e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:40:05 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-0dc8da57-2cc3-43f9-9668-d44252ed4848 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 200 len: 1543 microversion: 2.1 time: 0.260596 Apr 20 05:40:05 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 143/424] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:40:05 2023] GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 1543 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 05:40:05 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-2522ced5-add8-4ba2-8fea-48969b27e6ee req-24d439a2-9998-4b3f-8877-9b3b23392254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526b246a-2399-48c3-b422-d62065c10078", "name": "network-vif-unplugged", "status": "completed", "tag": "7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2522ced5-add8-4ba2-8fea-48969b27e6ee req-24d439a2-9998-4b3f-8877-9b3b23392254 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2522ced5-add8-4ba2-8fea-48969b27e6ee req-24d439a2-9998-4b3f-8877-9b3b23392254 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:05 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-2522ced5-add8-4ba2-8fea-48969b27e6ee req-24d439a2-9998-4b3f-8877-9b3b23392254 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:05 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-2522ced5-add8-4ba2-8fea-48969b27e6ee req-24d439a2-9998-4b3f-8877-9b3b23392254 service nova] Creating event network-vif-unplugged:7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f for instance 526b246a-2399-48c3-b422-d62065c10078 on user Apr 20 05:40:05 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-2522ced5-add8-4ba2-8fea-48969b27e6ee req-24d439a2-9998-4b3f-8877-9b3b23392254 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093491 Apr 20 05:40:05 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 145/425] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:06 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-f72eeea9-cbae-411e-b8e5-a6fa4b1f2fae req-7f6755d8-8708-44f3-bf7f-f24eb292b9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526b246a-2399-48c3-b422-d62065c10078", "name": "network-vif-deleted", "tag": "7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f72eeea9-cbae-411e-b8e5-a6fa4b1f2fae req-7f6755d8-8708-44f3-bf7f-f24eb292b9d0 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f72eeea9-cbae-411e-b8e5-a6fa4b1f2fae req-7f6755d8-8708-44f3-bf7f-f24eb292b9d0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:06 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-f72eeea9-cbae-411e-b8e5-a6fa4b1f2fae req-7f6755d8-8708-44f3-bf7f-f24eb292b9d0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:06 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-f72eeea9-cbae-411e-b8e5-a6fa4b1f2fae req-7f6755d8-8708-44f3-bf7f-f24eb292b9d0 service nova] Creating event network-vif-deleted:7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f for instance 526b246a-2399-48c3-b422-d62065c10078 on user Apr 20 05:40:06 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-f72eeea9-cbae-411e-b8e5-a6fa4b1f2fae req-7f6755d8-8708-44f3-bf7f-f24eb292b9d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089880 Apr 20 05:40:06 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 138/426] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:40:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-b7e7c22f-04f8-43ce-a998-54e8ee166ba2 req-b26adf19-6184-4807-aa6d-86a10f3aba47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "526b246a-2399-48c3-b422-d62065c10078", "name": "network-vif-plugged", "status": "completed", "tag": "7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b7e7c22f-04f8-43ce-a998-54e8ee166ba2 req-b26adf19-6184-4807-aa6d-86a10f3aba47 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b7e7c22f-04f8-43ce-a998-54e8ee166ba2 req-b26adf19-6184-4807-aa6d-86a10f3aba47 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-b7e7c22f-04f8-43ce-a998-54e8ee166ba2 req-b26adf19-6184-4807-aa6d-86a10f3aba47 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-b7e7c22f-04f8-43ce-a998-54e8ee166ba2 req-b26adf19-6184-4807-aa6d-86a10f3aba47 service nova] Creating event network-vif-plugged:7d1e2102-a93d-45c9-8f9a-f3604a7f8d1f for instance 526b246a-2399-48c3-b422-d62065c10078 on user Apr 20 05:40:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-b7e7c22f-04f8-43ce-a998-54e8ee166ba2 req-b26adf19-6184-4807-aa6d-86a10f3aba47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029730 Apr 20 05:40:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 144/427] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:40:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=4 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=8 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:16 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] Going to try to terminate instance {{(pid=72596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:40:16 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-5124cc03-0885-4750-8a30-bf5be6044a13 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b" status: 204 len: 0 microversion: 2.1 time: 0.110966 Apr 20 05:40:16 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 146/428] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:40:16 2023] DELETE /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:16 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:16 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell0:SELECT=2 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:16 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-73d9d63a-b6af-495e-96f2-f7aa169c83a1 req-7b8b416c-9f56-422c-a4b3-3fc53bc38ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b", "name": "network-vif-unplugged", "status": "completed", "tag": "3d86603a-0e8e-4603-ad53-5bb70894c3e9"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-73d9d63a-b6af-495e-96f2-f7aa169c83a1 req-7b8b416c-9f56-422c-a4b3-3fc53bc38ee0 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-73d9d63a-b6af-495e-96f2-f7aa169c83a1 req-7b8b416c-9f56-422c-a4b3-3fc53bc38ee0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:16 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-73d9d63a-b6af-495e-96f2-f7aa169c83a1 req-7b8b416c-9f56-422c-a4b3-3fc53bc38ee0 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:16 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-73d9d63a-b6af-495e-96f2-f7aa169c83a1 req-7b8b416c-9f56-422c-a4b3-3fc53bc38ee0 service nova] Creating event network-vif-unplugged:3d86603a-0e8e-4603-ad53-5bb70894c3e9 for instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b on user Apr 20 05:40:16 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-73d9d63a-b6af-495e-96f2-f7aa169c83a1 req-7b8b416c-9f56-422c-a4b3-3fc53bc38ee0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033522 Apr 20 05:40:16 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 145/429] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:40:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:17 user devstack@n-api.service[72598]: DEBUG nova.policy [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e47226cac2f843acaacca27801a0d415', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b35b59c7df742798e854837cc2df719', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72598) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:40:17 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-f1130e83-b6ba-4334-b4f6-a08b75240cb8 tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b" status: 200 len: 1491 microversion: 2.1 time: 0.335404 Apr 20 05:40:17 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 139/430] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:40:16 2023] GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b => generated 1491 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:17 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:18 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-5cbe599c-6905-4943-9c4e-6086d0e9bba6 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.205926 Apr 20 05:40:18 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 147/431] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 05:40:17 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc/os-interface => generated 282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:18 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-c8aeb7be-a401-437b-b4d9-1cf7599d14dd req-994f669f-821c-4d0b-9b79-f39e507bb1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c8aeb7be-a401-437b-b4d9-1cf7599d14dd req-994f669f-821c-4d0b-9b79-f39e507bb1be service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c8aeb7be-a401-437b-b4d9-1cf7599d14dd req-994f669f-821c-4d0b-9b79-f39e507bb1be service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:18 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-c8aeb7be-a401-437b-b4d9-1cf7599d14dd req-994f669f-821c-4d0b-9b79-f39e507bb1be service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:18 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-c8aeb7be-a401-437b-b4d9-1cf7599d14dd req-994f669f-821c-4d0b-9b79-f39e507bb1be service nova] Creating event network-changed:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:40:18 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-c8aeb7be-a401-437b-b4d9-1cf7599d14dd req-994f669f-821c-4d0b-9b79-f39e507bb1be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090657 Apr 20 05:40:18 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 146/432] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-681158703"}} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:18 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:19 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b", "name": "network-vif-plugged", "status": "completed", "tag": "3d86603a-0e8e-4603-ad53-5bb70894c3e9"}, {"server_uuid": "fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b", "name": "network-vif-deleted", "tag": "3d86603a-0e8e-4603-ad53-5bb70894c3e9"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:40:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:19 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] Creating event network-vif-plugged:3d86603a-0e8e-4603-ad53-5bb70894c3e9 for instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b on user Apr 20 05:40:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] Creating event network-vif-deleted:3d86603a-0e8e-4603-ad53-5bb70894c3e9 for instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b on user Apr 20 05:40:19 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-c8789ca3-51af-417d-bd4c-2fea72689270 req-64bfb7f0-08fe-4df3-a98d-41651cb0a7af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030067 Apr 20 05:40:19 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 148/433] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:40:18 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:40:19 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-77616d9d-eee3-48d7-a60c-6dfe5deb5b3e tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "POST /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc/action" status: 202 len: 0 microversion: 2.1 time: 0.827348 Apr 20 05:40:19 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 140/434] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 05:40:18 2023] POST /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc/action => generated 0 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 05:40:19 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-9de7aca3-7b9f-485e-8a05-7b0c4eef3a35 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '.version_select at 0x7ff3027212d0>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:19 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-9de7aca3-7b9f-485e-8a05-7b0c4eef3a35 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580" status: 200 len: 1610 microversion: 2.1 time: 0.064981 Apr 20 05:40:19 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 147/435] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 05:40:19 2023] GET /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580 => generated 1610 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:40:55 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:55 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] [instance: 526b246a-2399-48c3-b422-d62065c10078] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:40:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.wsgi [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] HTTP exception thrown: Instance 526b246a-2399-48c3-b422-d62065c10078 could not be found. Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Request method failure captured: Apr 20 05:40:56 user devstack@n-api.service[72596]: request: GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 HTTP/1.1 Apr 20 05:40:56 user devstack@n-api.service[72596]: Accept: application/json Apr 20 05:40:56 user devstack@n-api.service[72596]: Accept-Encoding: identity Apr 20 05:40:56 user devstack@n-api.service[72596]: Connection: close Apr 20 05:40:56 user devstack@n-api.service[72596]: Content-Length: 0 Apr 20 05:40:56 user devstack@n-api.service[72596]: Content-Type: application/json Apr 20 05:40:56 user devstack@n-api.service[72596]: Host: 10.0.0.210 Apr 20 05:40:56 user devstack@n-api.service[72596]: Openstack-System-Scope: None Apr 20 05:40:56 user devstack@n-api.service[72596]: User-Agent: python-urllib3/1.26.15 Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Auth-Token: gAAAAABkQM8T1v3-hQyP0S4liTnM4l2jcFMvXo8VJytZFBoBB1980f0J3o9N2ToywGvXz56qTFcKloALPy8KiW9u0fkr0SyMw4bJlP-0jnR6j4_1pPWpk9yjwkcigTuS_-lFsuO7daVaYlb6-x5dUiMBPDS-_4W6EdUMY1tf4aFXwcEfcj2-4rM Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Domain-Id: None Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Domain-Name: None Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Identity-Status: Confirmed Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Is-Admin-Project: True Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Project-Domain-Id: default Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Project-Domain-Name: Default Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Project-Id: 933c341c0bcc47a5927fd8961b4fea9e Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Project-Name: tempest-TestMinimumBasicScenario-945306862 Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Role: reader,member Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Roles: reader,member Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/933c341c0bcc47a5927fd8961b4fea9e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/933c341c0bcc47a5927fd8961b4fea9e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/933c341c0bcc47a5927fd8961b4fea9e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Tenant: tempest-TestMinimumBasicScenario-945306862 Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Tenant-Id: 933c341c0bcc47a5927fd8961b4fea9e Apr 20 05:40:56 user devstack@n-api.service[72596]: X-Tenant-Name: tempest-TestMinimumBasicScenario-945306862 Apr 20 05:40:56 user devstack@n-api.service[72596]: X-User: tempest-TestMinimumBasicScenario-945306862-project-member Apr 20 05:40:56 user devstack@n-api.service[72596]: X-User-Domain-Id: default Apr 20 05:40:56 user devstack@n-api.service[72596]: X-User-Domain-Name: Default Apr 20 05:40:56 user devstack@n-api.service[72596]: X-User-Id: 151ab31d22b943519eb10b95b8542cc5 Apr 20 05:40:56 user devstack@n-api.service[72596]: X-User-Name: tempest-TestMinimumBasicScenario-945306862-project-member Apr 20 05:40:56 user devstack@n-api.service[72596]: method: > Apr 20 05:40:56 user devstack@n-api.service[72596]: exception: Instance 526b246a-2399-48c3-b422-d62065c10078 could not be found. Apr 20 05:40:56 user devstack@n-api.service[72596]: action_args: {'id': '526b246a-2399-48c3-b422-d62065c10078'} Apr 20 05:40:56 user devstack@n-api.service[72596]: {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 526b246a-2399-48c3-b422-d62065c10078 could not be found. Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 526b246a-2399-48c3-b422-d62065c10078 could not be found. Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 526b246a-2399-48c3-b422-d62065c10078 could not be found. Apr 20 05:40:56 user devstack@n-api.service[72596]: ERROR nova.api.openstack.wsgi Apr 20 05:40:56 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Returning 404 to user: Instance 526b246a-2399-48c3-b422-d62065c10078 could not be found. {{(pid=72596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:40:56 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-bac18fe7-46e7-4606-a55c-ba25659fb8b9 tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078" status: 404 len: 111 microversion: 2.1 time: 0.232030 Apr 20 05:40:56 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 149/436] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:40:55 2023] GET /compute/v2.1/servers/526b246a-2399-48c3-b422-d62065c10078 => generated 111 bytes in 234 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:40:56 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:56 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:40:56 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-7dac7721-b1c9-47aa-b7b1-0615cec2e85c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] Calling method '.version_select at 0x7ff302a02050>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:40:56 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-7dac7721-b1c9-47aa-b7b1-0615cec2e85c tempest-TestMinimumBasicScenario-945306862 tempest-TestMinimumBasicScenario-945306862-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501039756" status: 202 len: 0 microversion: 2.1 time: 0.033692 Apr 20 05:40:56 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 141/437] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 05:40:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1501039756 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] [instance: fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=10 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=20 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:41:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.wsgi [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] HTTP exception thrown: Instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b could not be found. Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Request method failure captured: Apr 20 05:41:07 user devstack@n-api.service[72597]: request: GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b HTTP/1.1 Apr 20 05:41:07 user devstack@n-api.service[72597]: Accept: application/json Apr 20 05:41:07 user devstack@n-api.service[72597]: Accept-Encoding: identity Apr 20 05:41:07 user devstack@n-api.service[72597]: Connection: close Apr 20 05:41:07 user devstack@n-api.service[72597]: Content-Length: 0 Apr 20 05:41:07 user devstack@n-api.service[72597]: Content-Type: application/json Apr 20 05:41:07 user devstack@n-api.service[72597]: Host: 10.0.0.210 Apr 20 05:41:07 user devstack@n-api.service[72597]: Openstack-System-Scope: None Apr 20 05:41:07 user devstack@n-api.service[72597]: User-Agent: python-urllib3/1.26.15 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Auth-Token: gAAAAABkQM_M59X0x5h_yhOCjYs-clz8MQY7iOmFHYcEC15RZSQ3riIOz8AODlxTo2GMCXRc_8R9xouM-CKOjsItju3Q4YLMDooI_NNuJwNPrlfmEoGmkAsfuQF3ZWTz7N3Ga2qsIX-BYpB3M7c8hRkYrA02aXCg1BeX_bi72pNRO3ZQeMamkwA Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Domain-Id: None Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Domain-Name: None Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Identity-Status: Confirmed Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Is-Admin-Project: True Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Project-Domain-Id: default Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Project-Domain-Name: Default Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Project-Id: 3b35b59c7df742798e854837cc2df719 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Project-Name: tempest-VolumesActionsTest-1602720106 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Role: reader,member Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Roles: reader,member Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b35b59c7df742798e854837cc2df719"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3b35b59c7df742798e854837cc2df719"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3b35b59c7df742798e854837cc2df719"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Tenant: tempest-VolumesActionsTest-1602720106 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Tenant-Id: 3b35b59c7df742798e854837cc2df719 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-Tenant-Name: tempest-VolumesActionsTest-1602720106 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-User: tempest-VolumesActionsTest-1602720106-project-member Apr 20 05:41:07 user devstack@n-api.service[72597]: X-User-Domain-Id: default Apr 20 05:41:07 user devstack@n-api.service[72597]: X-User-Domain-Name: Default Apr 20 05:41:07 user devstack@n-api.service[72597]: X-User-Id: e47226cac2f843acaacca27801a0d415 Apr 20 05:41:07 user devstack@n-api.service[72597]: X-User-Name: tempest-VolumesActionsTest-1602720106-project-member Apr 20 05:41:07 user devstack@n-api.service[72597]: method: > Apr 20 05:41:07 user devstack@n-api.service[72597]: exception: Instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b could not be found. Apr 20 05:41:07 user devstack@n-api.service[72597]: action_args: {'id': 'fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b'} Apr 20 05:41:07 user devstack@n-api.service[72597]: {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b could not be found. Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b could not be found. Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b could not be found. Apr 20 05:41:07 user devstack@n-api.service[72597]: ERROR nova.api.openstack.wsgi Apr 20 05:41:07 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] Returning 404 to user: Instance fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b could not be found. {{(pid=72597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:41:07 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-8de8e822-04e4-4c8c-82a0-8798447dd49e tempest-VolumesActionsTest-1602720106 tempest-VolumesActionsTest-1602720106-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b" status: 404 len: 111 microversion: 2.1 time: 0.037374 Apr 20 05:41:07 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 148/438] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:41:07 2023] GET /compute/v2.1/servers/fce5cbed-4bd5-4e48-afdc-bf9d9c3c758b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 05:41:09 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-23b6f933-55e0-4990-9066-3b5a63797765 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '.version_select at 0x7ff302825510>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:41:09 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_api:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:41:09 user devstack@n-api.service[72596]: DEBUG dbcounter [-] [72596] Writing DB stats nova_cell1:SELECT=2 {{(pid=72596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:41:09 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-23b6f933-55e0-4990-9066-3b5a63797765 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580" status: 200 len: 1724 microversion: 2.1 time: 0.056256 Apr 20 05:41:09 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 150/439] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 05:41:09 2023] GET /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580 => generated 1724 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:41:09 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-c146d886-d521-4708-996a-2d760f2f95df tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '.version_select at 0x7ff30281f1c0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:41:10 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:41:10 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-c146d886-d521-4708-996a-2d760f2f95df tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580" status: 200 len: 1724 microversion: 2.1 time: 0.057661 Apr 20 05:41:10 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 142/440] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 05:41:09 2023] GET /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580 => generated 1724 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:41:10 user devstack@n-api.service[72597]: DEBUG nova.policy [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd186e766b78344a295b352fbfcccbab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5adc23748b041639625884af10dc569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:41:10 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-c51253f1-2eb0-48fe-a127-19ee04285759 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 200 len: 1671 microversion: 2.1 time: 0.220844 Apr 20 05:41:10 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 149/441] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:41:10 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 1671 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:10 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd186e766b78344a295b352fbfcccbab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5adc23748b041639625884af10dc569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:42:10 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-9e512bac-1c39-4739-8353-da2863341dc4 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 200 len: 1671 microversion: 2.1 time: 0.229874 Apr 20 05:42:10 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 151/442] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:42:10 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 1671 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:42:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-0b1a0f13-74b7-4bf7-b7a3-c93870e0e877 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '.version_select at 0x7ff3029a63b0>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:42:12 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-0b1a0f13-74b7-4bf7-b7a3-c93870e0e877 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580" status: 204 len: 0 microversion: 2.1 time: 0.205185 Apr 20 05:42:12 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 143/443] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:42:12 2023] DELETE /compute/v2.1/images/f8a7fd91-207a-4e8e-a891-4702b83c1580 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=4 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=8 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:12 user devstack@n-api.service[72597]: DEBUG nova.compute.api [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Going to try to terminate instance {{(pid=72597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 05:42:12 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-7a49a830-70a3-49d9-8c89-6b3d5c60b23a tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 204 len: 0 microversion: 2.1 time: 0.120236 Apr 20 05:42:12 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 150/444] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 05:42:12 2023] DELETE /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG nova.compute.api [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:12 user devstack@n-api.service[72596]: DEBUG nova.policy [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd186e766b78344a295b352fbfcccbab3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5adc23748b041639625884af10dc569', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 05:42:12 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [None req-c6e09aac-5b07-46d3-a0b4-2f3059b429c1 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 200 len: 1677 microversion: 2.1 time: 0.198353 Apr 20 05:42:12 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 152/445] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:42:12 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 1677 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 05:42:12 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [req-73f5d00b-12f7-4b52-9721-e9a68cb5ae15 req-b3b04d07-84e5-49e7-aa12-7f325a0ab275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "name": "network-vif-unplugged", "status": "completed", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:42:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-73f5d00b-12f7-4b52-9721-e9a68cb5ae15 req-b3b04d07-84e5-49e7-aa12-7f325a0ab275 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-73f5d00b-12f7-4b52-9721-e9a68cb5ae15 req-b3b04d07-84e5-49e7-aa12-7f325a0ab275 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:12 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [req-73f5d00b-12f7-4b52-9721-e9a68cb5ae15 req-b3b04d07-84e5-49e7-aa12-7f325a0ab275 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:13 user devstack@n-api.service[72598]: INFO nova.api.openstack.compute.server_external_events [req-73f5d00b-12f7-4b52-9721-e9a68cb5ae15 req-b3b04d07-84e5-49e7-aa12-7f325a0ab275 service nova] Creating event network-vif-unplugged:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:42:13 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [req-73f5d00b-12f7-4b52-9721-e9a68cb5ae15 req-b3b04d07-84e5-49e7-aa12-7f325a0ab275 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028457 Apr 20 05:42:13 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 144/446] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:42:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:42:14 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [req-584fa3a4-c185-4631-ae00-a7ba63e6282b req-0ad29e3d-2f50-4dac-aa7c-f42ce89a554e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "name": "network-vif-deleted", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:42:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-584fa3a4-c185-4631-ae00-a7ba63e6282b req-0ad29e3d-2f50-4dac-aa7c-f42ce89a554e service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-584fa3a4-c185-4631-ae00-a7ba63e6282b req-0ad29e3d-2f50-4dac-aa7c-f42ce89a554e service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:14 user devstack@n-api.service[72597]: DEBUG oslo_concurrency.lockutils [req-584fa3a4-c185-4631-ae00-a7ba63e6282b req-0ad29e3d-2f50-4dac-aa7c-f42ce89a554e service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:14 user devstack@n-api.service[72597]: INFO nova.api.openstack.compute.server_external_events [req-584fa3a4-c185-4631-ae00-a7ba63e6282b req-0ad29e3d-2f50-4dac-aa7c-f42ce89a554e service nova] Creating event network-vif-deleted:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:42:14 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [req-584fa3a4-c185-4631-ae00-a7ba63e6282b req-0ad29e3d-2f50-4dac-aa7c-f42ce89a554e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032550 Apr 20 05:42:14 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 151/447] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:42:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:42:15 user devstack@n-api.service[72596]: DEBUG nova.api.openstack.wsgi [req-d07b4a5d-709a-4f15-8d43-0fcbebed4212 req-eef0d736-07a5-4111-bbf9-0af3c732eeb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc1f03f2-d973-4427-9354-cadc0fe1cdfc", "name": "network-vif-plugged", "status": "completed", "tag": "290ee17c-ff7f-4f98-973f-be64c6824f63"}]} {{(pid=72596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 05:42:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d07b4a5d-709a-4f15-8d43-0fcbebed4212 req-eef0d736-07a5-4111-bbf9-0af3c732eeb6 service nova] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:42:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d07b4a5d-709a-4f15-8d43-0fcbebed4212 req-eef0d736-07a5-4111-bbf9-0af3c732eeb6 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:42:15 user devstack@n-api.service[72596]: DEBUG oslo_concurrency.lockutils [req-d07b4a5d-709a-4f15-8d43-0fcbebed4212 req-eef0d736-07a5-4111-bbf9-0af3c732eeb6 service nova] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:42:15 user devstack@n-api.service[72596]: INFO nova.api.openstack.compute.server_external_events [req-d07b4a5d-709a-4f15-8d43-0fcbebed4212 req-eef0d736-07a5-4111-bbf9-0af3c732eeb6 service nova] Creating event network-vif-plugged:290ee17c-ff7f-4f98-973f-be64c6824f63 for instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc on user Apr 20 05:42:15 user devstack@n-api.service[72596]: INFO nova.api.openstack.requestlog [req-d07b4a5d-709a-4f15-8d43-0fcbebed4212 req-eef0d736-07a5-4111-bbf9-0af3c732eeb6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029933 Apr 20 05:42:15 user devstack@n-api.service[72596]: [pid: 72596|app: 0|req: 153/448] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 05:42:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 05:43:02 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_api:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:43:02 user devstack@n-api.service[72598]: DEBUG dbcounter [-] [72598] Writing DB stats nova_cell1:SELECT=2 {{(pid=72598) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:43:02 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '>' {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:43:02 user devstack@n-api.service[72598]: DEBUG nova.compute.api [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] [instance: fc1f03f2-d973-4427-9354-cadc0fe1cdfc] Fetching instance by UUID {{(pid=72598) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Acquiring lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG oslo_concurrency.lockutils [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Lock "ae6ab1ab-1140-4b4c-bf55-c15161615bab" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=72598) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 05:43:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.wsgi [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] HTTP exception thrown: Instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc could not be found. Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Request method failure captured: Apr 20 05:43:03 user devstack@n-api.service[72598]: request: GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc HTTP/1.1 Apr 20 05:43:03 user devstack@n-api.service[72598]: Accept: application/json Apr 20 05:43:03 user devstack@n-api.service[72598]: Accept-Encoding: identity Apr 20 05:43:03 user devstack@n-api.service[72598]: Connection: close Apr 20 05:43:03 user devstack@n-api.service[72598]: Content-Length: 0 Apr 20 05:43:03 user devstack@n-api.service[72598]: Content-Type: application/json Apr 20 05:43:03 user devstack@n-api.service[72598]: Host: 10.0.0.210 Apr 20 05:43:03 user devstack@n-api.service[72598]: Openstack-System-Scope: None Apr 20 05:43:03 user devstack@n-api.service[72598]: User-Agent: python-urllib3/1.26.15 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Auth-Token: gAAAAABkQM_Q9nlRwveyZDvmDtw0_GnlAPUNo6uiQhD_YTzwEanorTDDtHRBuOQ9swNZyVj6NI0Qo4ynIfylg8PZAk2gumEfF436TXQ9QiG0URLLKJ1mqsYD5gjF7CZO3gDHrIX9AgsYqiWelIEoO_FjUh4GlDfjibNuSRDZCRqqETLW_2cjvlQ Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Domain-Id: None Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Domain-Name: None Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Identity-Status: Confirmed Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Is-Admin-Project: True Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Project-Domain-Id: default Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Project-Domain-Name: Default Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Project-Id: e5adc23748b041639625884af10dc569 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1533380158 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Role: reader,member Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Roles: reader,member Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5adc23748b041639625884af10dc569"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e5adc23748b041639625884af10dc569"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e5adc23748b041639625884af10dc569"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Tenant: tempest-ServerStableDeviceRescueTest-1533380158 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Tenant-Id: e5adc23748b041639625884af10dc569 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1533380158 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-User: tempest-ServerStableDeviceRescueTest-1533380158-project-member Apr 20 05:43:03 user devstack@n-api.service[72598]: X-User-Domain-Id: default Apr 20 05:43:03 user devstack@n-api.service[72598]: X-User-Domain-Name: Default Apr 20 05:43:03 user devstack@n-api.service[72598]: X-User-Id: d186e766b78344a295b352fbfcccbab3 Apr 20 05:43:03 user devstack@n-api.service[72598]: X-User-Name: tempest-ServerStableDeviceRescueTest-1533380158-project-member Apr 20 05:43:03 user devstack@n-api.service[72598]: method: > Apr 20 05:43:03 user devstack@n-api.service[72598]: exception: Instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc could not be found. Apr 20 05:43:03 user devstack@n-api.service[72598]: action_args: {'id': 'fc1f03f2-d973-4427-9354-cadc0fe1cdfc'} Apr 20 05:43:03 user devstack@n-api.service[72598]: {{(pid=72598) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc could not be found. Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc could not be found. Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc could not be found. Apr 20 05:43:03 user devstack@n-api.service[72598]: ERROR nova.api.openstack.wsgi Apr 20 05:43:03 user devstack@n-api.service[72598]: DEBUG nova.api.openstack.wsgi [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Returning 404 to user: Instance fc1f03f2-d973-4427-9354-cadc0fe1cdfc could not be found. {{(pid=72598) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 05:43:03 user devstack@n-api.service[72598]: INFO nova.api.openstack.requestlog [None req-23a2a5c4-4809-4e0a-8b44-2b1b0bb71682 tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc" status: 404 len: 111 microversion: 2.1 time: 0.043150 Apr 20 05:43:03 user devstack@n-api.service[72598]: [pid: 72598|app: 0|req: 145/449] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 05:43:02 2023] GET /compute/v2.1/servers/fc1f03f2-d973-4427-9354-cadc0fe1cdfc => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 05:43:03 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:43:03 user devstack@n-api.service[72597]: DEBUG dbcounter [-] [72597] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=72597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 05:43:03 user devstack@n-api.service[72597]: DEBUG nova.api.openstack.wsgi [None req-15163d25-5267-47dc-ae77-1a990386015b tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] Calling method '.version_select at 0x7ff302723be0>' {{(pid=72597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 05:43:03 user devstack@n-api.service[72597]: INFO nova.api.openstack.requestlog [None req-15163d25-5267-47dc-ae77-1a990386015b tempest-ServerStableDeviceRescueTest-1533380158 tempest-ServerStableDeviceRescueTest-1533380158-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-240490223" status: 202 len: 0 microversion: 2.1 time: 0.029241 Apr 20 05:43:03 user devstack@n-api.service[72597]: [pid: 72597|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 05:43:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-240490223 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)